this post was submitted on 03 Sep 2024
1611 points (100.0% liked)

Technology

70249 readers
3673 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 16 points 8 months ago* (last edited 8 months ago) (5 children)

Lol how about every pirate who fundamentally opposes the copyright system?

How about everyone who uses Google and doesn't want to see it shut down for scraping copyrighted content to provide a search engine?

Seriously, explain to me what's different at a fundamental level about OpenAI scraping the web and transforming the data through an LLM and Google scraping the web and transforming the data through their algorithms (which include LLMs)?

[–] [email protected] 46 points 8 months ago (1 children)

Google (used to) scrapes the specific details authorized by robots.txt and uses it to make your content visible.

OpenAI scrapes everything it can technically see, ignoring robots.txt and feeds i to a black box and regurgitates it claiming it’s something new, that it deserves to be paid for.

Quite different actually.

[–] [email protected] 8 points 8 months ago (1 children)

So if OpenAI complies with Robots.txt files then there's no issue right?

Because then they're identical. Open AI spent a bunch of money building a powerful system they feed those results to, as did Google.

[–] [email protected] 12 points 8 months ago

Web search used to be about scraping the web to find and present other people's work as just that... their work. Now the handful of websites claim ownership of the contributions of everyone, and at this point it's just corporations arguing about who owns your stuff. Pirates will not win out in this argument, except maybe in the very short term.

[–] [email protected] 8 points 8 months ago

Search engines provide source, they scrap for indexing, but your search gives a list of websites that matches that you will then likely visit. That's a big fundamental difference.

[–] [email protected] 5 points 8 months ago (1 children)

I dont see why why being downvoted you make some very good points.

Id actually like to see google shut down on copyright grounds. The innovation of necessity would drive foss search alternatives that just ignore said restrictions and most likly we would end up with a better product.

[–] [email protected] 3 points 8 months ago (1 children)

I appreciate the defense of the blind downvotes, though I can't say I necessarily see how Foss search engines would even be allowed to exist in that case?

[–] [email protected] 2 points 8 months ago (1 children)

There is a difference between allowed and what people do. Piracy isnt allowed u can still pirate literally anything if u want to tho.

[–] [email protected] 2 points 8 months ago (1 children)

You'd probably end up back with AI at that point. A lot easier to distribute a trained model then an entire web index.

[–] [email protected] 1 points 8 months ago (1 children)

Yep but at least the weights would be free

[–] [email protected] 1 points 8 months ago

But we do already have that with many LLMs. Both Meta and Microsoft have been publishing their models and weights open source for anyone to use.

[–] [email protected] 1 points 8 months ago (1 children)

Google doesn't sell the search engine as a product.

[–] [email protected] 1 points 8 months ago

Yes they do, just indirectly, it's how they monopolized the online advertising business.