Submitted by Tea_Pearce t3_10aq9id in MachineLearning
rafgro t1_j47678z wrote
Reply to comment by nohat in [D] Bitter lesson 2.0? by Tea_Pearce
See, it's not bitter lesson 1.0 when you replace "leverage computation" with "leverage large models that require hundreds of GPUs and entire internet". Sutton definitely did not write in his original essay that every bitter cycle ends with:
>breakthrough progress eventually arrives by an approach based on scaling computation
Viewing a single comment thread. View all comments