User-agent: * Disallow: /tags/ Disallow: /search/?*q=* Disallow: *csrfKey=* Disallow: /login/?do=* Disallow: /login/*&do= # Sogou does not behave correctly. Let this be a warning to all the other bots out there. User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: /