# # Robot Exclusion file for the CHIME WWW server # # Uses the Robot Exclusion Standard as specified in: # http://info.webcrawler.com/mak/projects/robots/norobots.html # # 13 August 1996 Anthony Peacock # 23 August 1996 internal directory added (AJP) # 17 February 1997 TMR material added (AJP) # 07 December 1998 Allowed the htdig user agent (AJP) # 10 July 2006 Disallowed prefetching by FasterFox # User-Agent: * Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /icons/ Disallow: /netboard/ Disallow: /perl5/ Disallow: /stats/ Disallow: /errors/ Disallow: /internal/ Disallow: /work-areas/ECDU/Trachoma/ Disallow: /APoGI/data/rtf/ Disallow: /APoGI/data/pdf/ Disallow: /work-areas/ECDU/ECM/Development/ Disallow: /about-chime/staff-list/ Disallow: /resources/Models/download/ User-Agent: chime-htdig Disallow: /cgi-bin/ Disallow: /bin/ Disallow: /icons/ Disallow: /netboard/ Disallow: /perl5/ Disallow: /stats/ Disallow: /errors/ Disallow: /internal/ Disallow: /work-areas/ECDU/Trachoma/ Disallow: /APoGI/data/rtf/ Disallow: /APoGI/data/pdf/ Disallow: /work-areas/ECDU/ECM/Development/ Disallow: /about-chime/staff-list/ Disallow: /resources/Models/download/ User-Agent: Fasterfox Disallow: /