cst1/openstreetmap-website
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Don't allow robots to fetch user edit lists

Browse source
This commit is contained in:
Tom Hughes 2010-04-20 22:40:32 +01:00
parent 9816c7dd0a
commit 7a8fe086cd
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
public/robots.txt
View file

@ -22,7 +22,7 @@ Disallow: /*relation=
User-agent: Slurp
Disallow: /user/*/traces/
Disallow: /user/*/edits/
Disallow: /user/*/edits
Disallow: /user/*/diary/
Allow: /user/
Disallow: /traces/tag/
@ -48,7 +48,7 @@ Disallow: /*relation=
User-agent: Googlebot
Disallow: /user/*/traces/
Disallow: /user/*/edits/
Disallow: /user/*/edits
Disallow: /user/*/diary/
Allow: /user/
Disallow: /traces/tag/