On Thursday, DuckDuckGo unveiled a brand new “AI Chat” service that permits customers to converse with 4 mid-range giant language fashions (LLMs) from OpenAI, Anthropic, Meta, and Mistral in an interface just like ChatGPT whereas trying to protect privateness and anonymity. Whereas the AI fashions concerned can output inaccurate info readily, the location permits customers to check totally different mid-range LLMs with out having to put in something or join an account.
DuckDuckGo’s AI Chat at present options entry to OpenAI’s GPT-3.5 Turbo, Anthropic’s Claude 3 Haiku, and two open supply fashions, Meta’s Llama 3 and Mistral’s Mixtral 8x7B. The service is at present free to make use of inside day by day limits. Customers can entry AI Chat by the DuckDuckGo search engine, direct hyperlinks to the location, or by utilizing “!ai” or “!chat” shortcuts within the search area. AI Chat can be disabled within the web site’s settings for customers with accounts.
Based on DuckDuckGo, chats on the service are anonymized, with metadata and IP handle eliminated to stop tracing again to people. The corporate states that chats will not be used for AI mannequin coaching, citing its privateness coverage and phrases of use.
“Now we have agreements in place with all mannequin suppliers to make sure that any saved chats are utterly deleted by the suppliers inside 30 days,” says DuckDuckGo, “and that not one of the chats made on our platform can be utilized to prepare or enhance the fashions.”
Nonetheless, the privateness expertise will not be bulletproof as a result of, within the case of GPT-3.5 and Claude Haiku, DuckDuckGo is required to ship a person’s inputs to distant servers for processing over the Web. Given sure inputs (i.e., “Hey, GPT, my identify is Bob, and I reside on Essential Road, and I simply murdered Invoice”), a person may nonetheless probably be recognized if such an excessive want arose.
Whereas the service seems to work properly for us, there is a query about its utility. For instance, whereas GPT-3.5 initially wowed folks when it launched with ChatGPT in 2022, it additionally confabulated so much—and it nonetheless does. GPT-4 was the primary main LLM to get confabulations underneath management to some extent the place the bot turned extra moderately helpful for some duties (although this itself is a controversial level), however that extra succesful mannequin is not current in DuckDuckGo’s AI Chat. Additionally lacking are comparable GPT-4-level fashions like Claude Opus or Google’s Gemini Extremely, seemingly as a result of they’re far dearer to run. DuckDuckGo says it might roll out paid plans sooner or later, and people could embrace greater day by day utilization limits or entry to “extra superior fashions.”)
It is true that the opposite three fashions usually (and subjectively) cross GPT-3.5 in functionality for coding with decrease hallucinations, however they’ll nonetheless make issues up, too. With DuckDuckGo AI Chat because it stands, the corporate is left with a chatbot novelty with an honest interface and the promise that your conversations with it’s going to stay non-public. However what use are totally non-public AI conversations if they’re filled with errors?
As DuckDuckGo itself states in its privateness coverage, “By its very nature, AI Chat generates textual content with restricted info. As such, Outputs that seem full or correct due to their element or specificity might not be. For instance, AI Chat can not dynamically retrieve info and so Outputs could also be outdated. You shouldn’t depend on any Output with out verifying its contents utilizing different sources, particularly for skilled recommendation (like medical, monetary, or authorized recommendation).”
So, have enjoyable speaking to bots, however tread rigorously. They’re going to simply “lie” to your face as a result of they do not perceive what they’re saying and are tuned to output statistically believable info, not factual references.