How to setup Robots.txt In OpenCart?

How to setup Roboto.txt file?

Robots.txt stands for robots dot txt.  Roboto.txt is a text file that helps search engines like Google, Bing to understand what information on a particular site needed to be indexed. It is a critical file to success for any e-commerce store.

Why we need this file ( Roboto.txt )?

Robots.txt file should be placed in the root directory of your website. It tell the search engines, which pages to skip and which to index. Webmasters use robots.txt files to help search engines index the content of their websites.  Robots.txt file is the simple and easy method of easing the process for spiders to provide more relevant search results.

Improve performance by the use of Roboto.txt file in Opencart.

There are two primary reasons of using roboto.txt file, which are mention below :

  1. Robots.txt will help prevent duplicate content issue, one of the primary thing for SEO success.
  2. Robots.txt also hide technical details about website  i.e. Error logs, SVN files, wanted directories etc. Since, these are prevented by Robots.txt you are left with clean URLs to be indexed in search engines.

 

Set Up Robots.txt in OpenCart

Robots.txt settings will only cover 1 domain at a time, so for multiple stores you have to create separate robots.txt files for each stores. Creating Robots.txt is super simple since it’s nothing but a text file . It is supposed to reside at root of your site

Example :  Ff your store domain is www.a2bizz.com you should put robots.txt file under the domain root where you also have app directory. So it sits and accessed like www.a2bizz.com/robots.txt.

Note : Search engines look for Robots.txt file directly under store root and not under a directory.

 

Roboto.txt for opencart :

Test version of roboto.txt is given below :

User-agent: *
    Disallow: /*&limit
    Disallow: /*?limit
    Disallow: /*?sort
    Disallow: /*&sort
    Disallow: /*?order
    Disallow: /*&order
    Disallow: /*?price
    Disallow: /*&price
    Disallow: /*?brand_tabletpc
    Disallow: /*&brand_tabletpc
    Disallow: /*?color_default
    Disallow: /*&color_default
    Disallow: /*?filter_tag
    Disallow: /*&filter_tag
    Disallow: /*?mode
    Disallow: /*&mode
    Disallow: /*?cat
    Disallow: /*&cat
    Disallow: /*?dir
    Disallow: /*&dir
    Disallow: /*?color
    Disallow: /*&color
    Disallow: /*?product_id
    Disallow: /*&product_id
    Disallow: /*?minprice
    Disallow: /*&minprice
    Disallow: /*?maxprice
    Disallow: /*&maxprice
    Disallow: /*?route=checkout/
    Disallow: /*?route=account/
    Disallow: /*?route=product/search
    Disallow: /*?page=1
    Disallow: /*&create=1
    Disallow: /?route=information/contact
    Disallow: /*?route=affiliate/
    Disallow: /*?keyword
    Disallow: /*?av
    Disallow: /admin/
    Disallow: /system/
    Disallow: /catalog/
 
    Sitemap: http://www.a2bizz.com/index.php?route=feed/google_sitemap