# FULL access (Google) User-agent: Googlebot Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp # FULL access (Alta Vista) User-agent: Scooter Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp # FULL access (FASTDisallow: /AllTheWeb) User-agent: FAST-WebCrawler Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp # FULL access (Inktomi) User-agent: Slurp Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp # FULL access (All Spiders) User-agent: * Disallow: /Whitepapers Disallow: /java Disallow: /images Disallow: /flash Disallow: /css Disallow: /App_Data Disallow: /products.asp