# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: NPBot Disallow: / User-agent: psbot Disallow: / User-agent: * Disallow: /include/calendar.aspx Disallow: /PopUp-Sell.htm Disallow: /PopUp-Buy.htm Disallow: /forgot.asp