summaryrefslogtreecommitdiff
path: root/internal/web/robots.go
AgeCommit message (Expand)AuthorFiles
2025-02-05[feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737)Libravatar tobi1
2025-02-04[feature] Change `instance-stats-randomize` to `instance-stats-mode` with mul...Libravatar tobi1
2025-02-03[chore] disallow /nodeinfo/ too (#3729)Libravatar jade arson.1
2025-01-03[chore] Update robots.txt with more AI bots (#3634)Libravatar Daenney1
2024-09-07[chore] More AI blocking (#3273)Libravatar Daenney1
2024-08-29[chore] Update robots.txt with more AI scrapers (#3248)Libravatar Daenney1
2024-08-02[feature] Beef up our AI opt-outs (#3165)Libravatar Daenney1
2024-07-10[choore] Update robots.txt (#3092)Libravatar Daenney1
2024-06-23[chore] Update our robots.txt (#3033)Libravatar Daenney1
2024-04-22[chore] Update robots.txt (#2856)Libravatar Daenney1
2024-04-11[feature] New user sign-up via web page (#2796)Libravatar tobi1
2024-02-27[feature] Block Amazonbot (#2692)Libravatar Daenney1
2023-12-27[chore] Refactor HTML templates and CSS (#2480)Libravatar tobi1
2023-09-30[feature] Block a bunch of "AI" crawlers (#2239)Libravatar Daenney1
2023-08-08[chore] Update robots.txt, give chatgpt the middle finger (#2085)Libravatar tobi1
2023-03-12[chore] Improve copyright header handling (#1608)Libravatar Daenney1
2023-01-25[feature] Public list of suspended domains (#1362)Libravatar f0x521
2023-01-05[chore] Update/add license headers for 2023 (#1304)Libravatar tobi1
2023-01-02[chore] The Big Middleware and API Refactor (tm) (#1250)Libravatar tobi1
2022-09-29[feature] Add `meta robots` tag; allow robots to index profile card if user i...Libravatar tobi1
generated by cgit v1.2.3 (git 2.46.0) at 2025-07-12 18:54:16 +0000