How to Create the best SEO friendly robots.txt for Blogger blog?

 If you are not getting traffic on your blog there may be an issue with robots.txt. Although in Blogger or Blogspot, it is already set by Go...

 If you are not getting traffic on your blog there may be an issue with robots.txt. Although in Blogger or Blogspot, it is already set by Google as a default. You can also find an option to use a custom robots.txt file in the blogger blog. So you can use extra functionality according to your needs.

I have created here some basic things which are most important for a blogger blog. Here we have provided you a sample robots.txt file for your blogger or Blogspot blog, just change your domain name.

User-Agent: *

Allow: /?display=wide

Allow: /?m=0

Allow: /?m=1

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=1&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=501&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=1001&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=1501&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=2001&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=2501&max-results=500

Sitemap: https://www.pradeeptomar.com/atom.xml?redirect=false&start-index=3001&max-results=500

Sitemap: https://www.pradeeptomar.com/sitemap-pages.xml


If you want to remove some posts from search engines then you follow the given below tricks. The "Disallow: /" tells the robots that it should not visit the pages on the site.

Disallow: /search -

If you want to remove search pages from Google search then you can put this robot's custom tag in your file.

Disallow: /p/page-name.html -

If you want to remove all the posts from Google search then you can put this robots custom tag in your file.

Disallow: /yyyy/mm/post-name.html -

If you want to remove all the posts from Google search then you can put this robots custom tag in your file.

How to add robots.txt to Blogger?

How to Create the best SEO robots.txt for Blogger blog?


To add Custom Robots. Txt to Blogger, Just follow these steps -

Sign in to your blogger blog.

Navigate to Settings >> Search Preferences ›› Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes.

Now paste the above robots. txt file code in the box.

Click on the Save button.

and now, you are done!


COMMENTS

  1. My blog post indexed.but my blog not crawling past 20 days. Any solution?

    ReplyDelete
    Replies
    1. Hello Dhaval,
      I was also facing same problem, But find solution
      Just login to Google Console.
      Remove your property and add again your website property using "URL Prefix".
      check all the errors carefully within next 7 days.
      I hope it will solve your problem.

      Delete
    2. Hello Dhaval, Please provide your blog url here.
      Although you should also add this in your robot.txt

      User-agent: Googlebot-Mobile
      Allow: /

      Delete
I am waiting for your suggestion / feedbacks, will reply you within 24-48 hours. :-)

Thanks for visit my Blog

Name

achievements,1,Affiliate-Marketing,1,Agriculture,1,Ajab-Gajab,9,Android,4,Applications,2,Astrology,2,Astronomy,1,Banking,12,Banks,18,Beauty-Tips,1,Blog,9,Blog-Design,1,Blogging,23,Business,5,Constitution,1,Content-Writter,2,Defence,2,Diseases,1,Download-Word-Samples,1,Drive-Traffic,1,e-Commerce,6,Earn-Money,20,Economics,1,Education,3,English,55,Entertainment,8,Entrepreneurs,5,Family,1,First-Aid,1,Gadgets,13,General-Safety,7,Government-Schemes,10,Hard-Reset,5,Haunted-Places,2,Health,12,Hindi,83,History,3,Human-Nature,5,Interesting-Facts,7,Internet,13,Internet-safety,3,Internet-Security,3,Laptop-Computer,11,Lifestyle,13,Media,1,Mobile,18,Modern-Science,1,Moral-Things,4,My-Reviews,18,Nation,14,Networking,2,Online-Startups,2,Opinion,6,Others,1,Personal-Thoughts,5,Photography,3,Politics,21,Property,1,Religion,35,Science-Space,2,SEO,9,Share-Market,3,Social,1,Social-Media,5,Start-a-Blog,2,Startups,14,Success-Tips,3,Technology,17,Telecom,19,Tomar Dynasty,1,Tourism-India,2,Transport,4,Travelling,1,Troubleshooting,13,USSD,11,Vedic-Science,1,Vlog,2,Vlogging,3,Web Services,2,Wellness,5,What-I-Think,45,Windows,4,World,10,YouTubers,2,
ltr
item
What I think | Pradeep Singh Tomar | BHARAT: How to Create the best SEO friendly robots.txt for Blogger blog?
How to Create the best SEO friendly robots.txt for Blogger blog?
https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgq1QmweKrlOTU98wfFJcjtPjEKUyZn3M-RIs5dFcLF47US3sRA1kKfkRu8x2uyQW1y-Wp_tWhUwVcj4UgfpWbvSHlsfs-fB0ehrTPF1Ckai-tvxYHganSQlFlOKvT8I2sjnqosh6EJ8C4/w640-h396/create-best-seo-robots-txt-file-for-blogger-blogspot-min.jpg
https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgq1QmweKrlOTU98wfFJcjtPjEKUyZn3M-RIs5dFcLF47US3sRA1kKfkRu8x2uyQW1y-Wp_tWhUwVcj4UgfpWbvSHlsfs-fB0ehrTPF1Ckai-tvxYHganSQlFlOKvT8I2sjnqosh6EJ8C4/s72-w640-c-h396/create-best-seo-robots-txt-file-for-blogger-blogspot-min.jpg
What I think | Pradeep Singh Tomar | BHARAT
https://www.pradeeptomar.com/2020/12/how-to-create-best-seo-friendly.html
https://www.pradeeptomar.com/
https://www.pradeeptomar.com/
https://www.pradeeptomar.com/2020/12/how-to-create-best-seo-friendly.html
true
6802886312559927823
UTF-8
Loaded All Posts Not found any posts VIEW ALL Readmore Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS PREMIUM CONTENT IS LOCKED STEP 1: Share to a social network STEP 2: Click the link on your social network Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy Table of Content