Robots.txt

From Cyborg Anthropology
Revision as of 00:04, 5 June 2011 by Caseorganic (Talk | contribs)

Jump to: navigation, search

Definition

"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.

External Links

http://www.javascriptkit.com/howto/robots.shtml