A significant observation for me was seeing Dall-E 2 go from muddled gibberish to clearly legible language in examples where smaller then larger models were used. This showed to me how particular scales bring certain points of progress and so moving from GPT-3 to GPT-4 will likely show another big jump in coherence.

(for the above I'm referring to prompts that asked for say an image with "a STOP sign", and the smaller models would show a sign with illegible characters, slowly improving until a certain point where clear typography was generated)