Portal Home > Knowledgebase > Articles Database > Hot to block myip.ms crawler\bot?


Hot to block myip.ms crawler\bot?




Posted by LazyWM, 05-13-2015, 12:48 PM
Hi guys! Maybe someone knows a solution. I think everyone known about this service - myip.ms Yeah, they cool and helpful But how i can block it? I don't want show my domains, ip, communication between domains, ip and etc It possible? Thanks

Posted by JustinAY, 05-14-2015, 11:45 PM
I would recommend mod_security here. You can also block via vhost or .htaccess on user string matches. Example below: http://www.thesitewizard.com/apache/...htaccess.shtml

Posted by LazyWM, 05-16-2015, 09:34 PM
Yeah. Thanks But i dont known. How i may block it By ip or useragent. What ip or user agent use myip.ms ??

Posted by anuja9991, 05-19-2015, 10:06 AM
Hello, Create robots.txt file in the document root of your domain say '/home/USER/public_html/robots.txt' and add following code in to that file. User-agent: *myip* [or may be actual user agent from the access log] Disallow: /

Posted by hostbrink, 05-19-2015, 09:21 PM
robots.txt is best solution for blocking crawler and bots.



Was this answer helpful?

Add to Favourites Add to Favourites    Print this Article Print this Article

Also Read
Checking Port Speed (Views: 670)
totalchoicehosting.com (Views: 707)
Duport Online Down (Views: 670)

Language: