Robot Txt Checker

Use the Robot Txt Checker tool to verify and test your robots.txt file. Verify which URLs are blocked or disallowed. Additionally, you may verify whether the page's resources (CSS, JavaScript, and pictures) are disallowed. 

The tool is not limited to just a URL; you can also apply restrictions to your website directory.