-1

We have setup one of web site on server and site build in php and symfony framework, As my requirement is to prevent Google from indexing and below of my robot.txt and Is prevent using .htaccess?

User-agent: *
Disallow:

So How to to prevent it and test?

Nullpointer
  • 180

1 Answers1

4

Your file should be named: robots.txt If you can see the content of the file on line : http://youwebsite/robots.txt, then it should be working. Otherwise you can test it with this google tool: https://support.google.com/webmasters/answer/6062598?hl=en

hyde
  • 41