It's an interesting approach. An RNN where the time constant ("memory" or "forgetting") changes depending on input, and forcing on the network is felt differently by the network depending on input.

The benchmark gains are nice, but only modest in general (except for driving, which appeared much better).

Altogether shows promise.