User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /cgi-bin/search2000 User-agent: ia_archiver Disallow: User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: TurnitinBot Disallow: / User-agent: CJ Spider Disallow: / User-agent: MicrosoftPrototypeCrawler Disallow: / User-agent: Zao Disallow: / User-agent: CJNetworkQuality Disallow: / User-agent: NPBot Disallow: /