Viewing a single comment thread. View all comments

CriticalTemperature1 t1_j6g6xv5 wrote on January 30, 2023 at 2:29 AM

The S4 Transformer uses structured state spaces which is a concept from EE that models the hidden state with differential equations. Seems to have SOTA results on a lot of tasks

a_khalid1999 OP t1_j6h20iq wrote on January 30, 2023 at 7:01 AM

Thanks, will look into it