this post was submitted on 19 Aug 2024
536 points (100.0% liked)

Technology

67422 readers
3534 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 98 points 7 months ago (2 children)
[–] [email protected] 59 points 7 months ago (1 children)

For now.

DDG gets search results from Bing, owned by Microsoft. And I wouldn't be surprised if the later did the same as Google did.

[–] [email protected] 37 points 7 months ago* (last edited 7 months ago) (4 children)

That's technically true, but it's as misleading as saying they get their search results from Yandex. Their results are aggregated from several search engines, not just Bing. They also have their own web crawler, DuckDuckBot, which absolutely respects RobotRules.

Edit: I'm told my information is out of date. No more Yandex because of Uncle Sam. Yahoo is just Bing now, so that index doesn't count anymore. The bulk of the rest of their sources are largely inconsequential specialized search engines. Their sources page states that they "largely source from Bing".

[–] [email protected] 4 points 7 months ago

Fair point.

load more comments (3 replies)
[–] [email protected] 13 points 7 months ago

DuckDuckGo is just Bing. Which is uh.. going from Google to Microsoft. Maybe not much better either

[–] [email protected] 62 points 7 months ago (1 children)

We're at a point where not only should the Internet be classified as a utility, so should Search.

[–] [email protected] 26 points 7 months ago* (last edited 7 months ago)

Yeah, it's not just e.g. water that is the utility, pipes and pumping stations are part of it. Otherwise you have water...uh...somewhere, go get it yourself.

[–] [email protected] 51 points 7 months ago

Oh look, more anticompetitive shenanigans.

Break Google up. Bring the full force of antitrust down on them.

Anything else is an unmitigated disaster waiting to happen.

[–] [email protected] 28 points 7 months ago* (last edited 7 months ago) (4 children)

Can someone explain why the fuck Google is pushing this so hard? Generative AI is not a general intelligence, and useless for concrete facts. Google has already demonstrated how shitty it is for information, and the people with the knowledge to work on the project have to know this.

So why the fuck are they all full steam ahead on something that will always be useless for them?

[–] [email protected] 36 points 7 months ago

Because the engineers aren't in charge anymore

[–] [email protected] 16 points 7 months ago* (last edited 7 months ago)

AI is hype.
They've recently signed a deal with Reddit for AI parsable data. Reddit reciprocated by allowing Google to be the only indexable search engine.
Google now thinks it can do the same to literally everyone else.
Googling is pretty damn mainstream.
Don't give Google your data, then don't be included in googles search results. It's like a flip of their previous trade with reddit, except it's not a trade. It's extortion.

Reddit never gave Google traffic. They gave them content and data.
And Google thinks it can withdraw traffic from other sites unless they get data in return.
Google is a monopoly.
Literally extortion

load more comments (2 replies)
[–] [email protected] 27 points 7 months ago (9 children)

Been on ddg for a few months now. Doesnt look like i need to go back either

load more comments (9 replies)
[–] [email protected] 23 points 7 months ago (1 children)

Lol... Peasants will accept it...

Sundar the creep knows it.

[–] [email protected] 25 points 7 months ago* (last edited 7 months ago)
[–] [email protected] 22 points 7 months ago (1 children)

So how do I actually opt out? My website is just some personal hobby stuff on wordpress that only friends and family look at, I don’t need seo.

[–] [email protected] 30 points 7 months ago* (last edited 7 months ago) (3 children)

You should put these entries into your robots.txt file.

To block the Google search crawler use for all of your site:

User-agent: Googlebot

Disallow: /

To block the Google AI crawler use:

User-agent: Google-Advanced

Disallow: /

load more comments (3 replies)
[–] [email protected] 22 points 7 months ago (6 children)

I've been really happy with Kagi since switching.

[–] [email protected] 8 points 7 months ago

Same! I swore I wouldn’t pay for a search engine, but I feel like it’s absolutely worth it, considering the current state of things.

load more comments (5 replies)
[–] [email protected] 20 points 7 months ago (2 children)

We do really need to figure how to make some kind of decentralized search engine.

[–] [email protected] 15 points 7 months ago
[–] [email protected] 9 points 7 months ago* (last edited 7 months ago)

I hope it happens one day, but that's an almost insurmountable task given the scale.

Take the entirety of the fediverse, and it's entire history, and you're probably talking a days worth of search engine indexing compute & storage.

The scale is large and the fediverse is incredibly small. Keeping my fingers crossed, but definitely not holding my breath.

In the meantime, I'll use Kagi.

[–] [email protected] 15 points 7 months ago (1 children)

If I say no and revoke my consent, and they do it anyway ...

[–] [email protected] 11 points 7 months ago (1 children)

Can you afford enough lawyers to prove it?

[–] [email protected] 10 points 7 months ago* (last edited 7 months ago)

Justice is the original pay to win game. Seems its out of our budget though.

[–] [email protected] 13 points 7 months ago (1 children)

That's actually a good news. Maybe we're able to revert the internet to the times before the Eternal September happened

[–] [email protected] 6 points 7 months ago (3 children)

This will never happen. We might get some of the issues more regulated, and people may move away from others, but you can't put the Furies back into the box. Things will change, but we will never have the early internet again.

load more comments (3 replies)
[–] [email protected] 11 points 7 months ago (7 children)

I've switched from DuckDuckGo to Ghostery Private search. I've been happier with the results than DDG.

load more comments (7 replies)
[–] [email protected] 9 points 7 months ago

Please understand that this is the next 'SEO' shit.

It was going to be this from the very start.

[–] [email protected] 6 points 7 months ago* (last edited 7 months ago)

Google is genuinely bad now. I switched to Ecosia which is just Bing with a simpler front end and they use their profits to plant trees. I don't think Ecosia is particularly special though. Duck Duck Go, Bing whatever, they're all better than Google.

Whenever I set up a new computer then search for something, I'm always surprised at first seeing the awful layout and quality of the search results before I realize that I haven't changed the default search from Google. It's awful now. Seriously, how are people using it?

My new favorite way to search is perplexity.ai. It's an AI search tool that summarizes the loads of crap out there so you don't need to read through the junk that people write. It provides sources, unlike using ChatGPT, which is incredibly valuable. All AIs make shit up, so having links to double check it is a must. Unlike Bing Chat, or whatever Microsoft calls it this week, you can ask follow up questions to home in on what you want.

[–] [email protected] 4 points 7 months ago

Google: "Making AI helpful for everyone..." (..mostly us!)

[–] [email protected] 4 points 7 months ago (4 children)

As I understand it, this is only about using search results for summaries. If it's just that and links to the source, I think it's OK. What would be absolutely unacceptable is to use the web in general as training data for text and image generation (=write me a story about topic XY).

[–] [email protected] 14 points 7 months ago (1 children)

If it's just that and links to the source, I think it's OK.

No one will click on the source, which means the only visitor to your site is Googlebot.

What would be absolutely unacceptable is to use the web in general as training data for text and image generation.

This has already happened and continues to happen.

[–] [email protected] 8 points 7 months ago (3 children)

No one will click on the source, which means the only visitor to your site is Googlebot.

That was the argument with the text snippets from news sources. Publishers successfully lobbied for laws to be passed in many countries that required search engine operators to pay fees. It backfired when Google removed the snippets from news sources that demanded fees from Google. Their visitors dropped by a massive amount, 90% or so, because those results were less attractive to Google users to click on than the nicer results with a snippet and a thumbnail. So "No one will click on the source" has already been disproven 10 or so years ago when the snippet issue was current. All those publishers have entered a free of charge licensing agreement with Google and the laws are still in place. So Google is fine, upstart search engines are not because those cannot pressure the publishers into free deals.

This has already happened and continues to happen.

With Gemini?

load more comments (3 replies)
load more comments (3 replies)
[–] [email protected] 4 points 7 months ago (1 children)

Bing to finally overtake Google? Inconceivable!

load more comments (1 replies)
load more comments
view more: next ›