elixir/static/robots.txt
Théo Lebrun e25b3d7c4b static: add /robots.txt
This is NOT being served by Elixir backend. The HTTP server in front
must serve it. Commit robots.txt to store the file somewhere.

Signed-off-by: Théo Lebrun <theo.lebrun@bootlin.com>
2024-09-27 18:19:11 +02:00

3 lines
38 B
Text

User-Agent: *
Allow: /
Crawl-Delay: 5