User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /clients/ Disallow: /downloads/ Disallow: /includes/ Disallow: /support/ Disallow: /404.php Disallow: /503.php Disallow: /blocked.php Disallow: /down.php Disallow: /quota.php User-agent: TurnitinBot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: QuepasaCreep Disallow: / User-agent: Jetbot Disallow: /