Viewing a single comment thread. View all comments

visarga t1_jdtyd0c wrote

Reply to comment by trajo123 in [D] GPT4 and coding problems by enryu42

> Perhaps get augmented with some sort of LSTM architecture where state can be built up from a theoretically infinite amount of input

That would be sweet, infinite input. Does RWKV do it?

1