Timur Ismagilov
|
2a1e6409c8
|
robots.txt: Allow /list, disallow /orphans
|
2022-05-07 02:00:40 +05:00 |
|
Timur Ismagilov
|
303ad8380f
|
Update robots.txt
|
2022-02-26 16:27:20 +03:00 |
|
Timur Ismagilov
|
cfc985a0f0
|
Disallow: /admin/ too
|
2021-10-01 09:51:06 +03:00 |
|
Umar Getagazov
|
1101784230
|
Replace Disallow: / with a more specific list
|
2021-09-29 22:20:30 +07:00 |
|
Timur Ismagilov
|
153430194b
|
Allow crawling /help/
|
2021-07-31 19:33:15 +05:00 |
|
handlerug
|
190a1d6ba8
|
Extract robots.txt into a file, simplify MIMEs
|
2021-06-23 22:44:27 +07:00 |
|