summaryrefslogtreecommitdiff
path: root/internal/api/robots/robots.go
AgeCommit message (Collapse)AuthorFiles
2025-02-24[feature] Use ETag for robots.txt to prevent mishaps (#3829)v0.18.1Libravatar tobi1
* [feature] Use ETag for robots.txt to prevent mishaps * check incoming if-none-match header
2025-02-05[feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737)Libravatar tobi1
* [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers * use switch for RobotsHeaders