Robots.txt Tester - Test Googlebot, Bingbot, or any custom user-agent instantly
Robots.txt Tester
Test Googlebot, Bingbot, or any custom user-agent instantly
Screenshots
Hunter's comment
Test whether a URL is allowed or blocked by robots.txt rules for Googlebot and other crawlers.
Link
This is posted on Steemhunt - A place where you can dig products and earn STEEM.
View on Steemhunt.com