282
submitted 5 months ago* (last edited 5 months ago) by [email protected] to c/[email protected]

We have paused all crawling as of Feb 6th, 2025 until we implement robots.txt support. Stats will not update during this period.

you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 1 points 5 months ago

In this scenario, I have multiple servers which are networked together and federated via ActivityPub but the server cluster itself is air gapped.

As to your questions about feasibility and purposes, I will admit I both didn't think about that, and should have been more clear that this air gapped federated instance was theoretical lol

[-] [email protected] 1 points 5 months ago

Then I’m not sure what point you were trying to make in the above conversation lol.

[-] [email protected] 1 points 5 months ago

The point was "don't add another bot into the pile of millions of bots that hit people's servers every day unless you're gonna be polite about it"

this post was submitted on 07 Feb 2025
282 points (100.0% liked)

Fediverse

35585 readers
123 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago
MODERATORS