Robots.txt Generator
Generate robots.txt file to control search engine crawlers.
Configuration
Use * for all bots or specify: Googlebot, Bingbot, etc.
One path per line (leave empty to allow all)
Optional: Specific paths to allow
Optional: Seconds between requests
Generated robots.txt
Upload this file to your website root directory (https://yoursite.com/robots.txt)