3dadaa4432
Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
2 lines
25 B
Text
2 lines
25 B
Text
User-Agent: *
|
|
Disallow:
|