Robots.txt: Difference between revisions
From Cyborg Anthro Wiki
Caseorganic (talk | contribs) No edit summary |
And.awarner (talk | contribs) No edit summary |
||
| Line 4: | Line 4: | ||
===External Links=== | ===External Links=== | ||
http://www.javascriptkit.com/howto/robots.shtml | http://www.javascriptkit.com/howto/robots.shtml | ||
Latest revision as of 20:36, 25 June 2011
Definition
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.
