Viewing a single comment thread. View all comments

Mental-Swordfish7129 t1_j2ta6bw wrote

Reply to comment by DeMorrr in [R] Do we really need 300 floats to represent the meaning of a word? Representing words with words - a logical approach to word embedding using a self-supervised Tsetlin Machine Autoencoder. by olegranmo

I know right. It happens over and over. Someone's great idea gets overlooked or forgotten and then later some people declare the idea "new" and the fanfare ensues. If you're not paying close attention, you won't notice that often the true innovation is very subtle. I'm not trying to put anyone down. It's common for innovation to be subtle and to rest on many other people's work. My model rests on a lot of brilliant people's work going all the way back the early 1900s

20

SoulCantBeCut t1_j2tfupv wrote

paging jurgen schmidhuber

18

unkz t1_j2ujn5z wrote

Please don’t, I think we have all heard enough from him.

2

currentscurrents t1_j2tuq1a wrote

There's a lot of old ideas that are a ton more useful now that we have more compute in one GPU than in their biggest supercomputers.

17