Robots.txt Generator
Create a proper robots.txt file to control how search engines crawl your website.
Quick Templates
Allow All
Allow search engines to crawl everythingBlock All
Block all search engines from crawlingSelective
Custom rules for different sectionsWordPress
Common rules for WordPress sitesAdd Custom Rule
Current Rules
No rules added yet. Start by selecting a template or adding custom rules.
Additional Settings
Preview
About Robots.txt Generator
This tool helps you create a proper robots.txt file by:
- Providing quick templates for common scenarios
- Supporting custom rules for specific search engines
- Including sitemap declarations
- Setting crawl-delay for rate limiting
- Generating standard robots.txt format