syeopite
|
92b04a30f3
|
Prevent indexing of Invidious instances (#2420)
Closes #2418
|
2021-09-22 01:29:51 +02:00 |
Paul Braeuning
|
e38b602b7d
|
Disallow /watch path for bots again
|
2021-06-14 10:40:59 +02:00 |
Omar Roth
|
6c19f0f242
|
Revert "Update robots.txt"
This reverts commit b26b6b9bdf.
|
2018-11-08 00:41:03 -06:00 |
|
Omar Roth
|
b26b6b9bdf
|
Update robots.txt
|
2018-11-06 23:13:31 -06:00 |
|
Omar Roth
|
5df7c43e5d
|
Ignore login in robots.txt
|
2018-03-24 23:15:03 -05:00 |
|
Omar Roth
|
d88b60979b
|
Add robots.txt
|
2018-02-05 18:11:59 -06:00 |