# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Allow: / Disallow: /invite Disallow: /class Disallow: /join Disallow: /lessons Disallow: /set_password Disallow: /admin Sitemap: https://tunelark-production.s3.us-west-1.amazonaws.com/sitemap.xml.gz Sitemap: https://blog.tunelark.com/sitemap_index.xml