How To Call Google Bots To Crawl Your Labeled Posts In Blogger?

By default Google bots only crawl the posts and pages of a blog. They do not crawl the other URLs of a blog such as URL of the labeled posts, Archived Posts and other search queries. Google does this to maintain the quality of a blog by not adding such URLs but if you are creating short posts that are not indexing on Google then you can try adding the labeled posts URLs on Google so that visitors can reach your blog through labeled URLs.

So if you want to index your labels URL on Google then you can do it easily through blogger settings. Many people do not know about this feature but blogger has provided this feature in blogger settings as search preferences mainly in crawling and indexing where you can fill different fields according to your requirements. For doing this you do not need to know much coding or anything, simply follow the step by step procedure given below.

• Log in to your Blogger Account.
• Then go to Settings >> Search preferences >> Crawling and Indexing.
• Then click on Edit tab given next to the robots.txt, ignore the warning and enter the following code in the box as shown in screenshots.

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Allow: /search
Allow: /

Sitemap: http://www.bloggenes.com/feeds/posts/default?orderby=UPDATED

To enlarge the image please click on it.

Customization: Replace my blog URL with your blog URL.

Note: Here the main code that is calling the Google bots to index your labeled posts is "Allow: /search". This command actually tells the Google bots index the URLs that contain "/search" keyword just after the domain. For Example : http://www.bloggenes.com/search/label/Blogger Tips

To know more about the above code read this post "How to setup the search preferences in blogger ? "

• Now click on Save changes tab.
• Then come to the next field that is custom robots header tags.
• Again click on Edit tab given next to Custom robots header tags, ignore the warning and click on the various fields as shown in screenshot.

To enlarge the image please click on it.

• Then click on Save changes tab and you are done. 
• Now your labels URLs will also be indexed by Google.