devol
/
teddit-reddit-frontend-alternativa
mirror of https://codeberg.org/teddit/teddit
1
0
Fork 0
Code Issues Releases Wiki Activity
teddit-reddit-frontend-alte.../static/robots.txt

4 lines
53 B
Plaintext
Raw Normal View History

blocking fucking annoying MJ12bot
2020-11-27 17:23:46 +01:00
User-agent: MJ12bot
disallow Applebot, crawls way too much
2021-11-18 20:29:24 +01:00
User-agent: Applebot
blocking fucking annoying MJ12bot
2020-11-27 17:23:46 +01:00
Disallow: /