Blogger Crawler and Indexing Setting For QUICK RANK ON GOOGLE FIRST PAGE

What is Robots TXT and Crawler

Robots.txt is a file that contains a collection of commands to the Robot Search Engine (Crawler) to crawl and index our blog to be easily found in search engines. With TXT robot settings on blogger we will give commands to the crawler bot where the page must be indexed and not on the blog.

 

How it will work on our blog

The robot TXT settings that we make on Blogger will facilitate the search engine work in a site, so that the articles in the blog post will be indexed quickly and easily found in the search page. Here's how to set it.

How to set a blogger txt robot

The form of a Robot TXT file already exists when a new blog is made, but it takes the right sideways so that the application of the arrangement does not experience an error and results in ignore by the search engine. Applying this TXT robot setting we will give permission for which page is indexed and that is not like a blog label page or other pages that are not important.

How to set robots.txt blogger SEO friendly.

 

Follow these steps:

1. Log in your blog.
2. Go to the settings menu and click.
3. Then find a crawler and indexing.
4. Activate custom robots.txt, pass by clicking the button beside until green.
5. Click on custom robots.txt.
6. Enter the file code below in custom robots.txt.

User-agent: Mediapartners-Google

Disallow: 

User-agent: *

Disallow: /search

Allow: /

Sitemap: https://sadhubani.blogspot.com/sitemap.xml

Change sadhubani.blogspot.com with your blog URL.

7. Click Save.

After you have finished saving the file, your blog already has a TXT robot file.

File code description on robots.txt.

Robot.txt file code above consists of 3 parts, as you can see on this image 

Namely:-

User-Agent: MediaPartners-Google.

User-Agent: MediaPartners-Google is a code for Google Partners like Google Adsense to help their robots in placing the best ads on our blog. Disallow: means it is not allowed.

User-Agent: *

Dalallow: / Search

Disallow: /p/about.html.

The asterisk (*) is marked for all robots, while disallow: it's not allowed to be indexed like a label or about.html page.

Allow: /

Sitemap:

Allowing the TXT robot to crawl your blog sitemap, the site map, so that all the post links in the sitemap will be indexed.

Now we will enter on how to check the robot.text that we have created on the blog in the following way:

Copy the code below.

https://www.sadhubani.blogspot.com/robots.txt.

Paste in your browser search page. Change www.sadhubani.blogspot.com with your domain.

Click Enter, the file will appear.

So in this article we,ll see  how to set the TXT blogger robot to facilitate the crawler robot in indexing on the blog. Thank you***