How is the compute getting paid for?
this post was submitted on 07 Jun 2024
303 points (100.0% liked)
Technology
67536 readers
6948 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
DDG makes money through ads and affiliate programs.
Oh yeah I might have to tell ublock to whitelist ddg so I can support them through ads
This is pretty cool, I have been using this chats with Claude and ChatGPT on DDGO since several weeks ago. I guess the new aspect is they incorporated more models like Mistral.
This is the best summary I could come up with:
On Thursday, DuckDuckGo unveiled a new "AI Chat" service that allows users to converse with four mid-range large language models (LLMs) from OpenAI, Anthropic, Meta, and Mistral in an interface similar to ChatGPT while attempting to preserve privacy and anonymity.
While the AI models involved can output inaccurate information readily, the site allows users to test different mid-range LLMs without having to install anything or sign up for an account.
DuckDuckGo's AI Chat currently features access to OpenAI's GPT-3.5 Turbo, Anthropic's Claude 3 Haiku, and two open source models, Meta's Llama 3 and Mistral's Mixtral 8x7B.
However, the privacy experience is not bulletproof because, in the case of GPT-3.5 and Claude Haiku, DuckDuckGo is required to send a user's inputs to remote servers for processing over the Internet.
Given certain inputs (i.e., "Hey, GPT, my name is Bob, and I live on Main Street, and I just murdered Bill"), a user could still potentially be identified if such an extreme need arose.
With DuckDuckGo AI Chat as it stands, the company is left with a chatbot novelty with a decent interface and the promise that your conversations with it will remain private.
The original article contains 603 words, the summary contains 192 words. Saved 68%. I'm a bot and I'm open source!
I could use that!
Update: it works fantastic and lets you switch easily to different AI models
I started using it when DDG and Startpage went down. Seems pretty handy. Good to know they've added more AI models.
And this is why I stopped using DDG. I swear, I'm just going to have to throw away my computer in the future if this fucking AI bullshit isn't thrown away like the thieving, energy-sucking, lying pile of garbage that it is.
If it’s using different AI models and allowing anonymity, I am not sure what’s the issue? Do you also object to using a calculator?
Calculator?! Those thieving, energy-sucking piles of garbage! Abacus till I die!
But seriously, AI is insidious in how it data mines us to give us answers, and data mines our questions to build profiles of users. I distrust assurances of anonymity by big data corpos.
I am not sure what method DDG is using for their model updates, I think it’s only fair if journalists follow up with them for clarification. Local LLMs, ones you can download to your machine for use, would circumvent privacy concerns if you’re not updating the weights in some way
Edit to clarify I meant updating the weights using online learning, but it’s still possible to update weights using pre trained weights you can download
You can disable ads and AI in the settings.
I don't see how we can prove this. Paying them to also spy on us is bad but allowing them replace our software c/localllama with their service is even worse. My funds are better spent on local AI development or device upgrade.
Honest question. How does their service "replace" an open source LLM? If I've got locallama on my machine, how does using their service replace my local install?
Yes, it does the same with less control, privacy.
So it isnt replacing it's offering an alternative tradeoff with more convenience/less control. I dont see how thats a bad thing?
After Reddit, some of us learnt not to throw away our control.
How anonymous is that thing ?
Ai needs data training & correction from us as user
Training and fine tuning happens offline for LLMs, it's not like they continuously learn by interacting with users. Sure, the company behind it might record conversations and use them to further tune the model, but it's not like these models inherently need that
You can train models of all kinds without disclosing anything personal about a user. Also see differential privacy
"Keep in mind that, as a model running through DuckDuckGo's privacy layer, I cannot access personal data, browsing history, or user information. My responses are generated on-the-fly based on the input you provide, and I do not have the ability to track or identify users."
Let’s be honest, regardless of whether or not this is true, it’s been instructed to say that.