All current language models mimic their input. If you say "there's bears in space" the language model will agree that there are bears in space because it's continuing the text as if you were writing it. You can think of a language model as an extension of whatever is typed into it. You can't use current language models for factual knowledge because they're not designed to output facts, they're designed to estimate what the next token should be when given input.