SuperSeriousBusiness/GoToSocial
1
1
Fork 0
mirror of https://github.com/superseriousbusiness/gotosocial synced 2025-06-05 21:59:39 +02:00
Code Issues Projects Releases Wiki Activity

[feature] Use ETag for robots.txt to prevent mishaps (#3829)

Browse Source 
* [feature] Use ETag for robots.txt to prevent mishaps

* check incoming if-none-match header
This commit is contained in:
tobi
2025-02-24 11:17:18 +01:00
committed by GitHub
parent c9de6c9a1e
commit fd670c6a27
3 changed files with 26 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
internal/api/util/robots.go
View File

@ -130,4 +130,9 @@ Disallow: /.well-known/webfinger
Disallow: /.well-known/nodeinfo
Disallow: /nodeinfo/
`
// MD5 hash of basic robots.txt.
RobotsTxtETag = `ce6729aacbb16fae3628210c04b462b7`
// MD5 hash of robots.txt with NodeInfo disallowed.
RobotsTxtDisallowNodeInfoETag = `a1e4ce6342978bc8d6c3e3dfab07cab4`
)