devol/wallabag
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Updated robots.txt to prevent crawling

Browse Source
This commit is contained in:
Nicolas Lœuillet 2017-12-15 21:51:12 +01:00
parent a68a80f654
commit e4ae6b976f
No known key found for this signature in database
GPG Key ID: 68C7E8049A047DF7
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
web/robots.txt
View File

@ -1,4 +1,2 @@
# www.robotstxt.org/
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
User-agent: *
Disallow: /