Home

robots disallow, robots.txt file allows only google and its partners- crawlers blocked. - Google Search Central, Robots.txt SEO How to Optimize and Validate Your Robots.txt