# robots.txt for www.newzealand.com - wwwroot/robots.txt User-agent: * Disallow: /cfdocs/ Disallow: /api/ Disallow: /CFIDE/ Disallow: /CFX_Tags/ Disallow: /CFXImageInfoSE/ Disallow: /deployapp/ Disallow: /images/ Disallow: /ITO/admin/ Disallow: /ITO/datafiles/ Disallow: /ITO/fff/ Disallow: /ITO/DTS/ Disallow: /ITO/images_activities/ Disallow: /ITO/images_events/ Disallow: /ITO/login/ Disallow: /ITO/site_down_html/ Disallow: /ITO/Site_Down_page/ Disallow: /ITO/templates/ Disallow: /ITO/tips/ Disallow: /shado-control/ Disallow: /shadomx/ Disallow: /travel/app_config/ Disallow: /travel/app_templates/ Disallow: /travel/cfcs/ Disallow: /travel/cfx_tags/ Disallow: /travel/config/ Disallow: /travel/flash/ Disallow: /travel/Images/ Disallow: Crawl-delay:10 # Access denied User-agent: *Fetch* Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: BorderManager* Disallow: / User-agent: webcollage* Disallow: / User-agent: Java* Disallow: / User-agent: grub-client Disallow: / User-agent: lwp* Disallow: / User-agent: *TunnelPro* Disallow: / User-agent: LinkWalker Disallow: / User-agent: Offline Explorer Disallow: / User-agent: larbin Disallow: /