Robots.txt: Difference between revisions
From Cyborg Anthro Wiki
Caseorganic (talk | contribs) Created page with '===Definition=== "Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. ===External Links=== http://www…' |
(No difference)
|
Revision as of 17:33, 1 February 2011
Definition
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.
