Robots.txt

From Cyborg Anthro Wiki
Revision as of 20:36, 25 June 2011 by And.awarner (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Definition

"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.

http://www.javascriptkit.com/howto/robots.shtml

Retrieved from "https://cyborganthropology.com/index.php?title=Robots.txt&oldid=4324"