Robots.txt is usually a file that exists on the basis directory of each website and can be employed to instruct engines like google on which directories/files of the web site they can crawl and incorporate in their index. Now that you've got a clear concept of what Search engine optimization https://news.rafeeg.ae