diff options
| author |  tobi <31960611+tsmethurst@users.noreply.github.com> | 2022-09-29 12:03:17 +0200 |
|---|---|---|
| committer |  GitHub <noreply@github.com> | 2022-09-29 12:03:17 +0200 |
| commit | dd83ad053c0cde5b948cbfe34ec4864cf0a123e3 (patch) | |
| tree | dbd53c7a2c98003c0ad96727ceaa572e4f7aa0eb /internal/web/robots.go | |
| parent | [frontend] Unified panels (#812) (diff) | |
| download | gotosocial-dd83ad053c0cde5b948cbfe34ec4864cf0a123e3.tar.xz | |
[feature] Add `meta robots` tag; allow robots to index profile card if user is Discoverable (#842)
* rework robots.txt response
* don't let robots snippet from statuses/threads
* allow robots to index if user is Discoverable
* add license text
Diffstat (limited to 'internal/web/robots.go')
| -rw-r--r-- | internal/web/robots.go | 24 |
1 files changed, 24 insertions, 0 deletions
diff --git a/internal/web/robots.go b/internal/web/robots.go new file mode 100644 index 000000000..c3307d068 --- /dev/null +++ b/internal/web/robots.go @@ -0,0 +1,24 @@ +/* + GoToSocial + Copyright (C) 2021-2022 GoToSocial Authors admin@gotosocial.org + + This program is free software: you can redistribute it and/or modify + it under the terms of the GNU Affero General Public License as published by + the Free Software Foundation, either version 3 of the License, or + (at your option) any later version. + + This program is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the + GNU Affero General Public License for more details. + + You should have received a copy of the GNU Affero General Public License + along with this program. If not, see <http://www.gnu.org/licenses/>. +*/ + +package web + +// https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag#robotsmeta +const ( + robotsAllowSome = "nofollow, noarchive, nositelinkssearchbox, max-image-preview:standard" +) |