You should watch the Ilya interview. He's confident there's still plenty of room for growth with just text but the real advancements will be multi-modal training data. I'd also take a look at Cerebras hardware. There's plenty of room for advancement with training hardware as well. We've got a LOT of runway ahead before hitting any real blocks and by then I'm 100% sure we'll have already hit self-improving AGI.