You know how Google’s new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won’t slide off (pssst…please don’t do this.)
Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these “hallucinations” are an “inherent feature” of AI large language models (LLM), which is what drives AI Overviews, and this feature “is still an unsolved problem.”
RAG is still the most reliable method for increasing accuracy and giving you the means of checking your sources.
“RAG”? The thing I clean my counters with?
Hah! I read that the guy who coined it regrets that he named it that. It stands for retrieval augmented generation. Is essentially ctrl-v. For example, instead of just asking it a question about a topic, feed it an entire course’s worth of text and notes on the topic and then ask it a question.