User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /intranet/ Disallow: /internal-pages/ Disallow: /site1/ Disallow: /spacecenter/