Block access to robots.txt file .htaccess

Question

I read in this forum that this .htaccess code should block access to the robot.txt file:

RewriteCond %{HTTP_USER_AGENT} ^Mozilla
RewriteCond %{HTTP_USER_AGENT} !(Slurp|surfsafely)
RewriteRule ^robots\.txt$ /someotherfile [L]

But I just get a error 500: "Internal Server Error"

What do I do wrong?

Exupery · Accepted Answer · 2012-06-10 19:20:35Z

up vote 1 down vote accepted

Make sure you have a file named "someotherfile" in your site's root (and also obviously a robots.txt file). Also the .htaccess should have RewriteEngine On somewhere above the block you posted.

answered Jun 10 '12 at 19:20

Exupery

Thank you soo much!! - I had the RewriteEngine On, but the problem was as you said that I haven't created a file named: "someotherfile" THANK YOU! :D – user1325927 Jun 10 '12 at 19:43

asked	1 year ago
viewed	311 times
active	4 months ago

Block access to robots.txt file .htaccess

migrated from stackoverflow.com Jun 29 '12 at 12:54

1 Answer

Your Answer

Block access to robots.txt file .htaccess

migrated from stackoverflow.com Jun 29 '12 at 12:54

1 Answer

Your Answer

Sign up or log in

Post as a guest

Related