User-agent: * Disallow: /weblog Disallow: /xsfs Disallow: /random Disallow: /mt User-agent: NPBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: QuepasaCreep Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: ia_archiver Disallow: /remotedotcomments/archives