Portal Home > Knowledgebase > Articles Database > Hot to block myip.ms crawler\bot?
Hot to block myip.ms crawler\bot?
Posted by LazyWM, 05-13-2015, 12:48 PM |
Hi guys!
Maybe someone knows a solution.
I think everyone known about this service - myip.ms
Yeah, they cool and helpful
But how i can block it? I don't want show my domains, ip, communication between domains, ip and etc
It possible?
Thanks
|
Posted by JustinAY, 05-14-2015, 11:45 PM |
I would recommend mod_security here.
You can also block via vhost or .htaccess on user string matches. Example below:
http://www.thesitewizard.com/apache/...htaccess.shtml
|
Posted by LazyWM, 05-16-2015, 09:34 PM |
Yeah. Thanks
But i dont known. How i may block it
By ip or useragent.
What ip or user agent use myip.ms ??
|
Posted by anuja9991, 05-19-2015, 10:06 AM |
Hello,
Create robots.txt file in the document root of your domain say '/home/USER/public_html/robots.txt' and add following code in to that file.
User-agent: *myip* [or may be actual user agent from the access log]
Disallow: /
|
Posted by hostbrink, 05-19-2015, 09:21 PM |
robots.txt is best solution for blocking crawler and bots.
|
Add to Favourites Print this Article
Also Read