portugalfuturista/elixir
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

static: add /robots.txt

Browse source 
This is NOT being served by Elixir backend. The HTTP server in front
must serve it. Commit robots.txt to store the file somewhere.

Signed-off-by: Théo Lebrun <theo.lebrun@bootlin.com>
This commit is contained in:
Théo Lebrun 2024-09-27 18:19:11 +02:00
parent 60699c4155
commit e25b3d7c4b
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
static/robots.txt Normal file
View file

@ -0,0 +1,3 @@
User-Agent: *
Allow: /
Crawl-Delay: 5