User-agent: * Disallow: /*.axd$ Disallow: /summerstudy/ Disallow: /westcoast/ Disallow: /samaritan/ Disallow: /article/ Disallow: /ambassador/ Disallow: /controls/ Disallow: /bin/ Disallow: /errorpage/ Disallow: /MaterPages/ Disallow: /images/ Disallow: /scripts/ Disallow: /styles/ Crawl-delay: 5 #delay in seconds for robots between pages downloads (used not to load sites too much)