Guys,

Robots.txt is a Standard used by websites to communicate with web crawlers and other web robots.
But I couldn't clearly understand the use of robots.txt in SEO.


Can someone explain the use of robots.txt in SEO?



Thank You!