Robots.txt: Difference between revisions
From Cyborg Anthro Wiki
Caseorganic (talk | contribs) Created page with '===Definition=== "Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. ===External Links=== http://www…' |
And.awarner (talk | contribs) No edit summary |
||
| (One intermediate revision by one other user not shown) | |||
| Line 1: | Line 1: | ||
===Definition=== | ===Definition=== | ||
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. | "Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. | ||
===External Links=== | ===External Links=== | ||
http://www.javascriptkit.com/howto/robots.shtml | http://www.javascriptkit.com/howto/robots.shtml | ||
Latest revision as of 20:36, 25 June 2011
Definition
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.
