timpibot
Timpi crawler, type: ai training.
- 181,652sites name it in robots.txt
- 117,823block it fully (64.9%)
- 7,689block some paths
- 56,140allow it explicitly
About this crawler
Downloads website content to include in datasets used for training AI models such as LLMs. Operated by Timpi, a decentralized network of independent node operators.
- User-Agent
Timpibot/1.0 (+http://timpi.io/crawler)- robots.txt token
timpibot- Respects robots.txt
- yes
- Source (third party, not confirmed by the operator)
- https://knownagents.com/agents/timpibot
- Third-party source (Known Agents, formerly Dark Visitors); Timpi does not confirm on this page.
- Source states it is expected to follow robots.txt and normally visits from Sweden; no IP list given.
- Source states no official verification method exists.
Including sites that block it only through the * group, 4.34% of all sites with a robots.txt keep it out.