Theres probably some level of scale necessary to start to see emergent properties but the point I tend to disagree on is people saying just throwing a NN at more and more data will suddenly give us AGI past a certain threshold. The human brain isn't just a bunch of neurons theres specialized regions all working together and I think this orchestration plus scale is what will take us to AGI