User-agent: * Disallow: /forums/ Disallow: /kz/template/search Disallow: /kz/template/activation Disallow: /kz/template/Activities Disallow: /kz/template/Resources Disallow: /kz/template/Downloads Disallow: /kz/template/SchoolSearch Disallow: /kz/screen/Download # On school sites, we also ban access to the public section Disallow: /kz/template/home Disallow: /kz/template/help Disallow: /kz/template/public # Carolena wants to ban access to the following file types Disallow: /images/ktz Disallow: /images/pdf Disallow: /images Disallow: /images/movies Disallow: /images/static_images # Next is for FAST Enterprise crawler. The user-agent is # the same as was used for a previous version of this crawler # -- I'm guessing it works for the current one. # # We're disallowing this robot because it doesn't seem to # understand ';jessionid' as a dynamic tag, and so goes around # our site in circles (although otherwise it is well behaved). User-agent: fastcrawler Disallow: / # The company says the above is incorrect, and the following # two should work User-agent: FAST Enterprise Crawler/6 Disallow: / User-agent: FAST Disallow: / User-agent: Googlebot-Image Disallow: /images/buyhome.jpg Disallow: /images/northhaven.jpg Disallow: /images/essexheights.jpg Disallow: /images/mtwaverleynp.jpg Disallow: /images/coriosouthps.jpg Disallow: /images/seaholme.jpg Disallow: /images/prev_off.gif Disallow: /images/seaholme.jpg Disallow: /images/nakaraps.jpg Disallow: /images/logo.gif Disallow: /images/nakaraps.jpg Disallow: /*.gif$ Disallow: /*.jpg$ User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.ktz$ Disallow: /*.ktz;jsessionid* Disallow: /*.dmg$ Disallow: /*.pdf$ Disallow: /*.mov$ # To remove dynamically generated pages Disallow: /*?