User-agent: MSNPTC/1.0 Disallow: /avibase/ User-Agent: Charlotte Disallow: / User-agent: msnbot Crawl-delay: 30 User-agent: * Disallow: /avibase/species.jsp Disallow: /servlet/org.bsc.links.GoToLink?id=*&archive=yes