#####
##### Rules for all user agents
#####

User-agent: *

### IPS Default (https://remoteservices.invisionpower.com/docs/robots_txt_info/) ###

# Block pages with no unique content
Disallow: /startTopic/
Disallow: /*?do=add
Disallow: /*?do=submit
Disallow: /discover/unread/
Disallow: /markallread/
Disallow: /staff/
Disallow: /online/
Disallow: /discover/
Disallow: /leaderboard/
Disallow: /search/
Disallow: /*?advancedSearchForm=
Disallow: /register/
Disallow: /lostpassword/
Disallow: /login/

# Block faceted pages and 301 redirect pages
Disallow: /*?sortby=
Disallow: /*?filter=
Disallow: /*?tab=comments
Disallow: /*?do=findComment
Disallow: /*?do=getLastComment
Disallow: /*?do=getNewComment

# Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
Disallow: /profile/

# Sitemap URL
Sitemap: https://linustechtips.com/sitemap.php

### Additional rules ###

Disallow: /tags/
Disallow: *csrfKey=*
Disallow: /status/
Disallow: *controller=profile*
Disallow: *do=showReactions*
Disallow: *do=find*
Disallow: *?do=embed*
Disallow: *controller=embed*

#####
##### The naughty list
#####

User-agent: Sogou web spider
Disallow: /
User-agent: Sogou inst spider
Disallow: /