Submitted by sidney_lumet t3_105syyz in MachineLearning
currentscurrents t1_j3epeo7 wrote
Reply to comment by junetwentyfirst2020 in [Discussion] Is there any alternative of deep learning ? by sidney_lumet
Transformers are just deep learning with attention.
And attention is just another neural network telling the first one where to look.
junetwentyfirst2020 t1_j3ftm38 wrote
That makes sense. Convolutional neural networks were just deep learning with convolution.
Viewing a single comment thread. View all comments