Jump to content

Let search engines crawl blog section

ahuckphin
 Share

Go to solution Solved by duncannah,

It seems like Google crawls it just fine, I was able to find a few blog posts with it. There isn't anything in the robots.txt file blocking it off either.

I don't believe that the blog section of this forum (linustechtips.com) is currently crawled by search engines. Feel like it would be useful if crawling happened. 

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

Yes, lets give bots more reason to come to it. /s

 

You say useful, care to expand on why?

^^^^ That's my post ^^^^
<-- This is me --- That's your scrollbar -->
vvvv Who's there? vvvv

Link to comment
Share on other sites

Link to post
Share on other sites

9 minutes ago, LogicalDrm said:

Yes, lets give bots more reason to come to it. /s

 

You say useful, care to expand on why?

Not all, but some blog posts do contain useful information.

 

I guess there is some overlap between regular forum and blog posts. 

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

It seems like Google crawls it just fine, I was able to find a few blog posts with it. There isn't anything in the robots.txt file blocking it off either.

🙂

Link to comment
Share on other sites

Link to post
Share on other sites

DuckDuckGo is already crawling the Blog section...

A PC Enthusiast since 2011
AMD Ryzen 7 5700X@4.65GHz | GIGABYTE GTX 1660 GAMING OC @ Core 2085MHz Memory 5000MHz
Cinebench R23: 15648cb | Unigine Superposition 1080p Extreme: 3566
Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, duncannah said:

It seems like Google crawls it just fine, I was able to find a few blog posts with it. There isn't anything in the robots.txt file blocking it off either.

you are correct... now I wonder how I was using Google 3 hours ago that lead me to create this thread.

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

It is true that we don't do much to actively push search indexes to index blogs, so it is possible that a blog may not get indexed, particularly if it's not linked to from anywhere else (either on or off the forum). We don't actively try to stop them from getting indexed though.

HTTP/2 203

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share


×