16.01.2024
Congratulations on Aaron, Sina, Roxana, Tim and Manos, great work! Now we are real ML people!
1. The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Tasks 2. Emergent mechanisms for long timescales depend on training curriculum and affect performance in memory tasks