# robots.txt for http://www.milepost1.com/, # derived from Nexor's robots.txt # See http://web.nexor.co.uk/users/mak/doc/robots/norobots.html # Original by Martijn Koster , # modified by Mark C. Swenson on Mar 14 1996 # User-agent: spider name (Ultraseek, * for all) # Disallow: /directory/ (e.g. /icons/) User-agent: * Disallow: /status/ Disallow: /stats/ Disallow: /icons/ Disallow: /img/