How is the compute getting paid for?
This is pretty cool, I have been using this chats with Claude and ChatGPT on DDGO since several weeks ago. I guess the new aspect is they incorporated more models like Mistral.
Couple good points in the comments -
Using LLMs to avoid the blank page problem:
For AI, bring your own data:
Anonymous or not, you’re still feeding it data
Not who you asked but you don’t want your AI to train itself based on the questions random users ask because it could introduce incorrect or offensive information. For this reason llms are usually trained and used in a separate step. If a user gave the llms private information you wouldn’t want it to learn that information and pass it on to other users so there are protections in place usually to stop it from learning new things while just processing requests.
These companies absolutely collect the prompt data and user session behavior. Who knows what kinda analytics they can use it for at any time in the future, even if it’s just assessing how happy the user was with the answers based on response. But having it detached from your person is good. Unless they can identify you based on metrics like time of day, speech patterns, etc
Prompt data is pointless and useless without a human to create a feedback loop for it, at which point it wouldn’t have context anyway. Also human effort to correct spelling dnd other user errors at the outset anyway. Hugely pointless and unreliable.
Not to mention, what good would it do for training? It wouldn’t help the model at all.
Not really. Depending on the implementation.
It’s not like ddg is going to keep training their own version of llama or mistral
I think they mean that a lot of careless people will give the AIs personally identifiable information or other sensitive information. Privacy and security are often breached due to human error, one way or another.
But these open models don’t really take new input into their models at any point. They don’t normally do that type of inference training.
But that’s a human error as you said, the only way to fix it is by using it correctly as an user. AI is a tool and it should be handled correctly like any other tool, be it a knife, a car, a password manager, a video recording program, a bank app or whatever.
I think a bigger issue here is that many people don’t care about their personal information as much as their lives.
https://duckduckgo.com/duckduckgo-help-pages/aichat/ai-chat-privacy/
your conversations are not used to train chat models by DuckDuckGo or the underlying model providers
This is the best summary I could come up with:
On Thursday, DuckDuckGo unveiled a new “AI Chat” service that allows users to converse with four mid-range large language models (LLMs) from OpenAI, Anthropic, Meta, and Mistral in an interface similar to ChatGPT while attempting to preserve privacy and anonymity.
While the AI models involved can output inaccurate information readily, the site allows users to test different mid-range LLMs without having to install anything or sign up for an account.
DuckDuckGo’s AI Chat currently features access to OpenAI’s GPT-3.5 Turbo, Anthropic’s Claude 3 Haiku, and two open source models, Meta’s Llama 3 and Mistral’s Mixtral 8x7B.
However, the privacy experience is not bulletproof because, in the case of GPT-3.5 and Claude Haiku, DuckDuckGo is required to send a user’s inputs to remote servers for processing over the Internet.
Given certain inputs (i.e., “Hey, GPT, my name is Bob, and I live on Main Street, and I just murdered Bill”), a user could still potentially be identified if such an extreme need arose.
With DuckDuckGo AI Chat as it stands, the company is left with a chatbot novelty with a decent interface and the promise that your conversations with it will remain private.
The original article contains 603 words, the summary contains 192 words. Saved 68%. I’m a bot and I’m open source!
