I want to disallow
/book-search and currently there is a rule in robots.txt like below:
When I try with Webmasters Tool robots.txt tester, it says
/book-search is still allowed.
Is it because of
@@? What is the meaning of
Best How To :
@@ has no reserved meaning in the robots.txt specification.
So a line like
Disallow: /@@example will disallow crawling of URLs whose path literally starts with
If you want to disallow crawling of URLs whose path starts with
/book-search, then you should use:
(without a trailing
This will disallow crawling, for example: