User-agent * Disallow: / Disallow: /cgi-bin/ Disallow: /LDP/ Disallow: /internal/ Disallow: /webevent/ Disallow: /images/ Disallow: /css/ Disallow: *pdf Disallow: *mov