FediDB.org has resumed crawling with robots.txt support

submitted 2 months ago by

squirrel@discuss.tchncs.de

mastodon.social/@dansup/114023239339067181

FediDB.org has resumed crawling with robots.txt support, it may take 48h for all stats and caching to update accordingly.

For more info on how to block FediDB, see https://fedidb.org/crawler.html

Back to main discussion

mesa

2 months ago

Awesome! Good outcome for everyone involved.

Create post

Join

Fediverse

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

Local members: 416 Invite people to join
Posts: 1326
Comments: 44642