Your name or email adress:
Do you already have an account?
Forgot your password?
  • Log in or Sign up

    Results 1 to 3 of 3
    1. #1
      Join Date
      Aug 2014
      Location
      india
      Posts
      147
      MTV$
      212
      Thanks
      0
      Thanked 5 Times in 5 Posts

      What is Robots.txt ?

      Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site.

    2. # ADS
      Advertise here Circuit advertisement
      Join Date
      My Birthday
      Location
      Advertising world
      Posts
      Million and counting
       
    3. #2
      Join Date
      May 2014
      Location
      Inida
      Posts
      297
      MTV$
      405
      Thanks
      1
      Thanked 6 Times in 6 Posts

      Re: What is Robots.txt ?

      Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

    4. #3
      Join Date
      Sep 2016
      Posts
      149
      MTV$
      293
      Thanks
      0
      Thanked 2 Times in 2 Posts

      Re: What is Robots.txt ?

      A robots.txt file is a file at the root of your site that indicates those parts of your site you donít want accessed by search engine crawlers. The file uses the Robots Exclusion Standard, which is a protocol with a small set of commands that can be used to indicate access to your site by section and by specific kinds of web crawlers (such as mobile crawlers vs desktop crawlers).


      Delhi To Manali Volvo Bus Booking | Team Building Organisers in Delhi

    Thread Information

    Users Browsing this Thread

    There are currently 1 users browsing this thread. (0 members and 1 guests)

    Bookmarks

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •