What should the robots.txt say?

What Is a Robots.txt File & How It Affects SEO

The robots.txt file is a simple text file placed on your web server which tells webcrawlers like Googlebot if they should access...

Sourabh Jul 5, 2016 9 min read