SuperSeriousBusiness/GoToSocial
1
1
Fork 0
mirror of https://github.com/superseriousbusiness/gotosocial synced 2025-06-05 21:59:39 +02:00
Code Issues Projects Releases Wiki Activity

[feature] Use X-Robots-Tag headers to instruct scrapers/crawlers (#3737)

Browse Source 
* [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers

* use switch for RobotsHeaders
This commit is contained in:
tobi
2025-02-05 12:47:13 +01:00
committed by GitHub
parent bfb81f5bac
commit baed591a1d
15 changed files with 311 additions and 142 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
internal/web/profile.go
View File

@@ -103,7 +103,7 @@ func (m *Module) profileGETHandler(c *gin.Context) {
// index if account is discoverable.
var robotsMeta string
if targetAccount.Discoverable {
robotsMeta = robotsMetaAllowSome
robotsMeta = apiutil.RobotsDirectivesAllowSome
}
// We need to change our response slightly if the