7 lines
93 B
Plaintext
7 lines
93 B
Plaintext
User-agent: *
|
|
Allow: /page/
|
|
Allow: /hypha/
|
|
Allow: /recent-changes
|
|
Disallow: /
|
|
Crawl-delay: 5
|