Bear in mind robots.txt is the portion where you are issuing Guidance to the search engines robots on which directories they ought to not take a look at. Look for syntax mistakes. Just one blunder inside the syntax within your Robots.txt file can cause it to fail, so you'll want https://rankingseotoolz.com/robots-txt-generator