This commit is contained in:
2026-03-02 08:40:30 -07:00
parent 2b013f390b
commit 9955a7f90c
39 changed files with 1388 additions and 1 deletions

View File

@@ -0,0 +1,5 @@
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: /