# Robots.txt for infosec.wales - Defensive Cybersecurity Education Platform # Security-focused configuration for search engines User-agent: * # Allow public educational content Allow: / Allow: /guides/ Allow: /mythbusting/ Allow: /explainers/ Allow: /simulator/ Allow: /data/ # Block sensitive directories and files Disallow: /private/ Disallow: /cgi-bin/ Disallow: /includes/ Disallow: /logs/ Disallow: /errors/ Disallow: /.htaccess Disallow: /assets/config/ Disallow: /*.log$ # Block common attack patterns Disallow: /admin/ Disallow: /wp-admin/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /phpmyadmin/ Disallow: /.env Disallow: /config/ # Additional security patterns Disallow: /*?debug= Disallow: /*?test= Disallow: /*?dev= Disallow: /*.bak Disallow: /*.backup Disallow: /*.old Disallow: /*.tmp # Crawl delay to prevent server overload Crawl-delay: 1 # Sitemap location (will be created in future phases) Sitemap: https://infosec.wales/sitemap.xml # Security.txt for responsible disclosure # Future implementation: /security.txt or /.well-known/security.txt