Commit graph

1 commit

Author SHA1 Message Date
tobi baed591a1d
[feature] Use X-Robots-Tag headers to instruct scrapers/crawlers (#3737)
* [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers

* use switch for RobotsHeaders
2025-02-05 12:47:13 +01:00
Renamed from internal/web/robots.go (Browse further)