gotosocial/internal/middleware
Daenney 9b50151f17
[feature] Beef up our AI opt-outs ()
* [chore] Synchronise our robots.txt with upstream

* [feature] Add headers to escape AI crawlers

This adds 2 headers that a number of AI crawlers respect to signal that
content should not be included in their datasets.
2024-08-02 18:22:39 +02:00
..
cachecontrol.go [bugfix] Set Vary header correctly on cache-control () 2023-07-13 21:27:25 +02:00
contentsecuritypolicy.go [feature] Set some security related headers () 2024-07-04 10:07:02 +02:00
contentsecuritypolicy_test.go [feature] Add rate limit exceptions option, use ISO8601 for rate limit reset () 2023-08-23 14:32:27 +02:00
cors.go [chore] Replace pinafore with semaphore () 2023-05-21 22:40:43 +02:00
extraheaders.go [feature] Beef up our AI opt-outs () 2024-08-02 18:22:39 +02:00
gzip.go [chore] Improve copyright header handling () 2023-03-12 16:00:57 +01:00
headerfilter.go [feature] request blocking by http headers () 2023-12-18 14:18:25 +00:00
headerfilter_test.go [feature] request blocking by http headers () 2023-12-18 14:18:25 +00:00
logger.go [feature] Log pubKeyID for http-signed requests () 2024-01-09 10:41:15 +01:00
ratelimit.go [feature] request blocking by http headers () 2023-12-18 14:18:25 +00:00
ratelimit_test.go [feature] Add rate limit exceptions option, use ISO8601 for rate limit reset () 2023-08-23 14:32:27 +02:00
requestid.go [chore] ensure worker contexts have request ID () 2023-08-15 17:01:01 +01:00
session.go [chore] Improve copyright header handling () 2023-03-12 16:00:57 +01:00
session_test.go [chore] Improve copyright header handling () 2023-03-12 16:00:57 +01:00
signaturecheck.go [feature] Try HTTP signature validation with and without query params for incoming requests () 2024-01-31 14:15:28 +00:00
throttling.go [performance] simpler throttling logic () 2023-12-16 12:53:42 +01:00
throttling_test.go [bugfix] increases sleep time before check in throttle test, to give more leeway () 2024-01-03 10:27:55 +00:00
tokencheck.go [performance] remove last of relational queries to instead rely on caches () 2023-08-10 15:08:41 +01:00
useragent.go [feature] request blocking by http headers () 2023-12-18 14:18:25 +00:00
util.go [feature] request blocking by http headers () 2023-12-18 14:18:25 +00:00