Factuality is not a guarantee either with LLMs...

IMHO, those models are very good for general knowledge that can be sucked up from public sources.

When it comes to proprietary / confidential data / knowledge, this is where your work will pay off.