Use a Browser. <br/> Agent:CCBot/1.0 (+http://www.commoncrawl.org/bot.html)<br/><a href="/hsz/modules/hotspotportal/portal.php?hsz_hotspot=robots.txt">Proceed with /hsz/modules/hotspotportal/portal.php?hsz_hotspot=robots.txt</a>