Okay that's about everything

This commit is contained in:
benbot 2023-10-25 23:19:22 -04:00
parent 023ad47ae4
commit d094ff036f
19 changed files with 236 additions and 79 deletions

View file

@ -0,0 +1,5 @@
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: /