# Crawlers' blocked content User-agent: * Disallow: /images Disallow: /aspnet_client Disallow: /downloads Disallow: /archived Disallow: /assets Disallow: /internal Disallow: /index_test.php User-agent: Googlebot-Image Disallow: /