Difference between revisions of "Robots.txt"

From Cyborg Anthropology
Jump to: navigation, search
(Created page with '===Definition=== "Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web. ===External Links=== http://www…')
 
 
(One intermediate revision by one other user not shown)
Line 1: Line 1:
 
===Definition===
 
===Definition===
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.
+
"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.  
  
 
===External Links===
 
===External Links===
 
http://www.javascriptkit.com/howto/robots.shtml
 
http://www.javascriptkit.com/howto/robots.shtml
 
[[Category:Book Pages]]
 
[[Category:Unfinished]]
 

Latest revision as of 20:36, 25 June 2011

Definition

"Robots.txt" is a regular text file that through its name, has special meaning to the majority of "honorable" robots on the web.

External Links

http://www.javascriptkit.com/howto/robots.shtml