Exponential Error Decay

Lag q:

Decay:

Sigmoid: max f’=0.25; |weights|ɜ.0; vanish! (higher weights useless - derivatives disappear)

Previous slide Next slide Back to first slide View graphic version

Back to J. Schmidhuber's Recurrent neural network page