Google Webmaster Tools error "Url blocked by robots.txt."

I have a WordPress website, I submitted it to Google Webmaster and after submitting the sitemap, it's giving me error "URL blocked by robots.txt".

Please help, what should I do?

Topic google-xml-sitemaps robots.txt customization Wordpress

Category Web

1
answered at

You can read this article.

Some from there:

  1. This error appears when Google is unable to crawl the specific URL due to a robots.txt restriction.
  2. Google is unable to crawl this URL for a variety of reasons. The following places may contain a statement that prevents crawling.
    • <meta name=”robots” content=”noindex” />
    • X-Robots-Tag: noindex
    • Disallow: [Path Or / ] (in robots.txt. file)
1
answered at

Try to go Settings --> Reading, take a look if Search Engine Visibility is checked, and in this case unchecked. Now the robots.txt has disallow only wp-admin path

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.