mirror of https://github.com/searx/searx
[mod] disallow search results for robots
This commit is contained in:
parent
295fc9ce96
commit
dceb903114
|
@ -657,6 +657,7 @@ Allow: /
|
|||
Allow: /about
|
||||
Disallow: /stats
|
||||
Disallow: /preferences
|
||||
Disallow: /*?*q=*
|
||||
""", mimetype='text/plain')
|
||||
|
||||
|
||||
|
|
Loading…
Reference in New Issue