DoctorAtlantis.bsky.social: I'm slowly developing a heuristic for whether or not to trust LLMs. I've found it pretty reliable and wanted to share it: Did the answer come from an LLM? Yes: You should fact-check the answer. No: You should still fact-check the answer. I hope you find this as helpful as I have.

I'm slowly developing a heuristic for whether or not to trust LLMs. I've found it pretty reliable and wanted to share it: Did the answer come from an LLM? Yes: You should fact-check the answer. No: You should still fact-check the answer. I hope you find this as helpful as I have.

Yep. Just like if it came from a search engine, Wikipedia, etc. This "don't trust LLMs" is just a rehashing of the same arguments used against internet technology. And it's tiring seeing this rhetoric repeat over and over again.

It’s a bit like algorithms or crimes, but on a computer. Just because the thing happens in a new place, you don’t suddenly need whole new laws.

Post