Test Result

Allowed Robots / Crawlers:

Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
Megalodon
Mediapartners-Google
*

Responses

Robots.txt: http://slashdot.jp/robots.txt
Status: 200 OK
Tested: http://slashdot.jp/ (search, cache)
Status: 200 OK

About

Quick robots.txt checker to test which robots are disallowed or allowed to index/archive contents. recognizes robots.txt and <meta> tag specified by Google.

Bookmarklet: test robots.txt

Parmalink: http://forbiddenrobots.usb0.net/?url=http%3A%2F%2Fslashdot.jp%2F