Update robots.txt to prevent crawling of domain blocks (#26470)

Co-authored-by: Claire <claire.github-309c@sitedethib.com>
This commit is contained in:
Robert R George 2024-12-02 00:03:24 -08:00 committed by GitHub
parent a17e7d10fc
commit a98a8ee93f
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -6,3 +6,4 @@ Disallow: /
User-agent: * User-agent: *
Disallow: /media_proxy/ Disallow: /media_proxy/
Disallow: /interact/ Disallow: /interact/
Disallow: /api/v1/instance/domain_blocks