Parts of the Internet now only searchable on specific sites now? What next - charging a monthly subscription to use Google?
This needs to be regulated before the Internet becomes like streaming TV.
this post was submitted on 24 Jul 2024
190 points (100.0% liked)
Technology
71355 readers
3185 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
Excellent! Now I won't get reddit results and then have to filter them out!
Sounds great to me. With reddit gone maybe we can start to find what we are looking for without having to go sort through reddit.
Thank you Lemmy, for making it so much easier to walk away from that dumpster fire!
Alright then. The 3rd party app drama already pushed me here. I really won't go back for anything if I'm not allowed to search for Reddit anymore.
This seems illegal to me 😮
Is Google really permitted to prevent any other search engine from looking at Reddit?
I guess Reddit is permitted to only let Google index it
Are they though?
I don't know of any law that says that they can't.
I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.
You can just require a log in to view content, or just flat out auto ban indexing robots.
How can they do that, logistically?
Like I realize there's a flag they can raise that asks not to be indexed but that's not legally binding.
I guess they can make it hard to index by scraping by rate limiting or requiring login to view content etc and only provide Google the api to bypass the restrictions
There's probably a lot of ways to do it
just begin with site:reddit.com test for brave search and it still works
did you set time limit to last week? old posts are still indexed. just tried "site:reddit.com df:w" on DDG and no hits
I can confirm, it works just fine on brave search. I set the time limit to yesterday and it still gave me results
test site:reddit.com works fine from DDG for me.
set the date filter to something recent, test site:reddit.com df:w (results from last week only) gives 0 hours hits
This shouldn't be allowed
Fixed
Well that's annoying. One work around is to use a redirect extension like Libredirect and you can still search via the !reddit bang on DuckDuckGo. Thusly if I type into my search bar which has DuckDuckGo as default:
!reddit some new post or topic, it will search reddit for the search term, then when it attempts to load the reddit page, the libredirect extension will redirect and show the results.
Requires a bit of configuring and sure is annoying, but hey, no Google search necessary to get the up to date reddit threads.
And Brave Search