facebookbot
Meta crawler, type: ai training.
- 1,295,241sites name it in robots.txt
- 295,045block it fully (22.8%)
- 920,717block some paths
- 79,479allow it explicitly
About this crawler
Web crawler used by Meta to download training data for its AI speech recognition technology.
- User-Agent
Mozilla/5.0 (compatible; FacebookBot/1.0; +https://developers.facebook.com/docs/sharing/webmasters/facebookbot/)- robots.txt token
facebookbot- Respects robots.txt
- yes
- Source (third party, not confirmed by the operator)
- https://knownagents.com/agents/facebookbot
- Third-party source (Known Agents / Dark Visitors); the UA string itself links to a Meta developer page that was not fetched.
- Source says it is expected to follow robots.txt.
- Source says no official verification method exists.
Including sites that block it only through the * group, 4.56% of all sites with a robots.txt keep it out.