Robots.txt

March 13, 2006

Robots.txt: A file used within the root directory of a website that restricts the indexing of selected web pages or directories.