TL;DR: LLMs are just mimicking natural language and conversation. Fact checking and healthy skepticism is not part of their model. For example they can be easily tricked into advocating conspiracy theories, like a fake moon landing. Google Bard is even stating arithmetic falsehoods like 5*6 != 30
The only use so far with any value (moral or factual) seems to be insane entertainment. I can’t stop having a chuckle of the Harry Squatter videos and interactions people have with Neuro-sama.
I think trying to use this for anything even remotely factual is just asking for a paddlin’.