Brilliant. Fixing LLMs' inaccuracy by using already existing search technology to look up the real answer and then blend that answer into whatever the LLM generates, so the generated answer has a better chance of resembling the real answer, which was looked up but not shown to the querent.
“The LLM is still guessing answers, but with RAG [retrieval augmented generation], it's just that the guesses are often improved because it is told where to look for answers…”
“There's still no deep understanding of words and the world…”
Just like NFTs before them, all the ways people come up with to make LLMs useful involve stapling them to functional programs that don't need them and could do the job better without the unnecessary layer of overhyped scamware
"Can we make randomized text output tend towards resembling the truth" would be an interesting experiment if it weren't environmentally ruinous, but the best outcome is never going to be intelligence, nor as effective and efficient as a search engine
This is like those reality shows about dodgy restaurants, where it turns out they don't really have a kitchen and are just ordering takeaway from nearby competitors and serving it to their customers and pretending they cooked it themselves.
Reminds me of early Silicon Valley episode where the failed app startup guy had the idea to make an app that remembered where your car was in a parking garage. “Why don’t you just write it down?”
I am not advocating for this as a solution, but it's baffling to me that Google didn't just implement it this way in the first place.
When you have a tool that already can find the right answer, why wouldn't you just feed that answer to the natural language machine?
i'm pretty sure Google *did* do this; the results from their AI nonsense that people were laughing about recently were all taken from posts on various websites seemingly based on their pagerank or similar
the problem is that popular isn't always right
it's really telling that they only now got the idea to check their work. i mean i never need to edit or verify the correctness of my work, because i only shit out excellence
Search engine uses AI to look up information
↓
AI uses search engine to refine results
↓
Search engine uses AI to look up information
↓
AI uses search engine to refine results
↓
Search engine uses AI to look up information
↓
AI uses search engine to refine results
↓
Search engine uses AI to ...