Forum Replies Created

Viewing 1 post (of 1 total)
  • Author
    Posts
  • July 19, 2019 at 11:39 AM in reply to: use of robots.txt #18020
    Digitalguide
    Participant

    robos.txt is a text file it has conditions for Crawlers. They are
    1. Allow
    2. Dis-Allow
    Allow condition is for to read the file of the website.
    Disallow conditions is for not to read the file of the website.

     

  • Author
    Posts
Viewing 1 post (of 1 total)