>Everything they write has to come from something they've seen in their database.

The models learn ideas and concepts, they don't just copy text. Now, using an idea without giving credit is plagiarism, that makes it problematic that they can't cite sources for generated text. However they don't simply recreate prior sentences under normal conditions.