Direct Answer • Key Takeaway
Lstms Solve the Problem Using a Unique Additive Gradient Structure That Includes Direct Access to the Forget Gate's Activations, Enabling the Network to Encourage Desired Behaviour from the Error Gradient Using Frequent Gates Update on Every Time Step of the Learning Process.
