User-Agent: *
Allow: /

Disallow: /intranet
Disallow: /tmp
Disallow: /ftp