diff options
| author | mms <michal@sapka.me> | 2023-12-12 21:58:27 +0100 |
|---|---|---|
| committer | mms <michal@sapka.me> | 2023-12-12 21:58:27 +0100 |
| commit | cc3dfd5191967915d89f12c2a3ca00410cc6753b (patch) | |
| tree | d12ab59412efaf4553be8077d12525cb61a7c4cc /static | |
| parent | 72b44f302d41df3caceed23cb925dc382b864996 (diff) | |
chore: allow-list robots
Diffstat (limited to 'static')
| -rw-r--r-- | static/robots.txt | 11 |
1 files changed, 10 insertions, 1 deletions
diff --git a/static/robots.txt b/static/robots.txt index e43089d..5cb473b 100644 --- a/static/robots.txt +++ b/static/robots.txt @@ -1,4 +1,13 @@ User-agent: * -Disallow: /michal.gpg +Disallow: / + +User-agent: Applebot +User-agent: Bingbot +User-agent: DuckDuckBot +User-agent: DuckDuckGo +User-agent: Googlebot +User-agent: ia_archiver +User-agent: Slurp +User-agent: Yandexbot Sitemap: https://d-s.sh/sitemap.xml |