5 lines
106 B
Plaintext
5 lines
106 B
Plaintext
|
# www.robotstxt.org/
|
||
|
|
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
|
||
|
|
|
||
|
|
User-agent: *
|