GoToSocial/internal/middleware
Daenney 9b50151f17
[feature] Beef up our AI opt-outs (#3165)
* [chore] Synchronise our robots.txt with upstream

* [feature] Add headers to escape AI crawlers

This adds 2 headers that a number of AI crawlers respect to signal that
content should not be included in their datasets.
2024-08-02 18:22:39 +02:00
..
cachecontrol.go [bugfix] Set Vary header correctly on cache-control (#1988) 2023-07-13 21:27:25 +02:00
contentsecuritypolicy.go [feature] Set some security related headers (#3065) 2024-07-04 10:07:02 +02:00
contentsecuritypolicy_test.go [feature] Add rate limit exceptions option, use ISO8601 for rate limit reset (#2151) 2023-08-23 14:32:27 +02:00
cors.go [chore] Replace pinafore with semaphore (#1801) 2023-05-21 22:40:43 +02:00
extraheaders.go [feature] Beef up our AI opt-outs (#3165) 2024-08-02 18:22:39 +02:00
gzip.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
headerfilter.go [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00
headerfilter_test.go [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00
logger.go [feature] Log pubKeyID for http-signed requests (#2501) 2024-01-09 10:41:15 +01:00
ratelimit.go [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00
ratelimit_test.go [feature] Add rate limit exceptions option, use ISO8601 for rate limit reset (#2151) 2023-08-23 14:32:27 +02:00
requestid.go [chore] ensure worker contexts have request ID (#2120) 2023-08-15 17:01:01 +01:00
session.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
session_test.go [chore] Improve copyright header handling (#1608) 2023-03-12 16:00:57 +01:00
signaturecheck.go [feature] Try HTTP signature validation with and without query params for incoming requests (#2591) 2024-01-31 14:15:28 +00:00
throttling.go [performance] simpler throttling logic (#2407) 2023-12-16 12:53:42 +01:00
throttling_test.go [bugfix] increases sleep time before check in throttle test, to give more leeway (#2482) 2024-01-03 10:27:55 +00:00
tokencheck.go [performance] remove last of relational queries to instead rely on caches (#2091) 2023-08-10 15:08:41 +01:00
useragent.go [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00
util.go [feature] request blocking by http headers (#2409) 2023-12-18 14:18:25 +00:00