User-agent: *
Crawl-delay: 10

User-agent: Twitterbot
Crawl-delay: 0
Disallow:

User-agent: Mozilla/4.0 (compatible; ICS)
Disallow: /