diff options
| author |  Daenney <daenney@users.noreply.github.com> | 2024-09-07 17:21:36 +0200 |
|---|---|---|
| committer |  GitHub <noreply@github.com> | 2024-09-07 17:21:36 +0200 |
| commit | 0e2ee857ac6bd959a668e02ac45bddb765795b56 (patch) | |
| tree | 02b8ae13404c0100f30032fa0ff3fe52f3c1942f /internal/web/robots.go | |
| parent | fix new processing media / emoji not being added to dereferencer maps (#3269) (diff) | |
| download | gotosocial-0e2ee857ac6bd959a668e02ac45bddb765795b56.tar.xz | |
[chore] More AI blocking (#3273)
Diffstat (limited to 'internal/web/robots.go')
| -rw-r--r-- | internal/web/robots.go | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/internal/web/robots.go b/internal/web/robots.go index be0126109..4945aa9fc 100644 --- a/internal/web/robots.go +++ b/internal/web/robots.go @@ -52,6 +52,7 @@ User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video User-agent: GPTBot +User-agent: iaskspider/2.0 User-agent: ICC-Crawler User-agent: ImagesiftBot User-agent: img2dataset |