Due to the nature of our work, my firm has had early access to most LLMs including Bard (now Gemini). I might be short on imagination but I honestly cannot see how LLM general search implementations can ever be fixed. There is too much garbage data for any system to be able to intelligently parse and the results of our tests were laughable. Now, if you offer LLM search that is restricted to curated datasets like “The Library of Congress” or peer reviewed scientific papers, I can see the value in that. You’ll probably still have to triple check your results, but at least it can get you 80% of the way there rather than sending you in the wrong direction.
EDIT: For context, our clientele are all enterprises with very large, mission critical systems. They are not the type to use some buggy trinket just because it’s new and cool.
yes, I find Gemini actually not bad when it comes to my specific use case of showing generic examples for R programming, so I can figure out the syntax for my actual code. I don’t try to have it generate actual code for me because my topic of marine biogeochemistry is far too specific for it to have any idea how to work with it. Unlike ChatGPT, which often makes up nonsense functions or hallucinates whole packages, Gemini seems to do ok. I also found it pretty good for generating images of natural subjects. It did the best job of generating a pic of a giant clam of any image generator I’ve tried. I would never trust factual information from Gemini. So like Google+, it’s a pretty good product that in no way should be shunted into search results, Google Docs and other places where its output is not relevant, yet that is exactly the trap Google is falling into again.
Due to the nature of our work, my firm has had early access to most LLMs including Bard (now Gemini). I might be short on imagination but I honestly cannot see how LLM general search implementations can ever be fixed. There is too much garbage data for any system to be able to intelligently parse and the results of our tests were laughable. Now, if you offer LLM search that is restricted to curated datasets like “The Library of Congress” or peer reviewed scientific papers, I can see the value in that. You’ll probably still have to triple check your results, but at least it can get you 80% of the way there rather than sending you in the wrong direction.
EDIT: For context, our clientele are all enterprises with very large, mission critical systems. They are not the type to use some buggy trinket just because it’s new and cool.
yes, I find Gemini actually not bad when it comes to my specific use case of showing generic examples for R programming, so I can figure out the syntax for my actual code. I don’t try to have it generate actual code for me because my topic of marine biogeochemistry is far too specific for it to have any idea how to work with it. Unlike ChatGPT, which often makes up nonsense functions or hallucinates whole packages, Gemini seems to do ok. I also found it pretty good for generating images of natural subjects. It did the best job of generating a pic of a giant clam of any image generator I’ve tried. I would never trust factual information from Gemini. So like Google+, it’s a pretty good product that in no way should be shunted into search results, Google Docs and other places where its output is not relevant, yet that is exactly the trap Google is falling into again.
Every time. It’d be funny if it didn’t mean people constantly being punished and losing their jobs for errors made at the executive level.