Remarkably, English is a language that likes to be violated so that it can adapt to new situations.

But if you are referring to the singular they, both Chaucer and Shakespeare used the singular they and it is an established part of the language.