Yeah... that is maybe stretching it. Worthwhile thing to notice though is this linear trend. Never mind parity with human translated text, if the trend continues it will reach zero editing needed which would be really something.

Still, while language modeling is amazing, can it really be extended to more general tasks? I don't think it's so straightforward matter. It's well exemplified that language models don't do arithmetic or logic, getting around that bottleneck is not trivial. Getting it to work reliably even less so. And then you need to get the AI to write some internal self referencing, self correcting monologue to break down and solve more complex tasks.

I don't think it's terribly clear what all the challenges involved even are. We don't really understand how our own intelligence works, so it's not like we can mimic nature here.