Immedion Ashville, NC Network Issue

Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > Immedion Ashville, NC Network Issue

Posted by Snoork Hosting, 02-26-2012, 01:24 AM
Anyone currently experiencing network problems at Immedion facility in Ashville, NC?
Posted by turbovps, 02-26-2012, 01:25 AM
Yes, seems gblx to netriplex.
Posted by Rogean, 02-26-2012, 01:26 AM
Yes, they said they are experiencing a network level event and have people working on it currently.
Posted by bhavicp, 02-26-2012, 01:41 AM
Anyone have any further/detailed details?
Posted by gone-afk, 02-26-2012, 01:52 AM
Over an hour of constant flapping now.
Posted by bhavicp, 02-26-2012, 01:53 AM
Anyone know if the SLA changed when Immedion took over? I actually completely forgot to check this with my rep!
Posted by gone-afk, 02-26-2012, 01:55 AM
Beyond caring about SLAs personally.
Posted by alnitech, 02-26-2012, 02:03 AM
The only thing i know for sure pricing has changed so same SLA for x10 money (1G now cost $9000 per month).
Posted by gone-afk, 02-26-2012, 02:39 AM
7 minutes away from being a 2 hour event, yippidy doo da!
Posted by brc_csf, 02-26-2012, 02:45 AM
100% down from every place I have tried. Can't even reach the support page.
Posted by bhavicp, 02-26-2012, 02:46 AM
They REALLY need to host the support page offsite or have a backup off-site.
Posted by gone-afk, 02-26-2012, 02:48 AM
Just broke the 2 hour mark 3 minutes ago, an all time low in our relationship I'd say.
Posted by redsolution, 02-26-2012, 02:49 AM
2 years worst journey to have rtsp/voip servers on netriplex
Posted by alnitech, 02-26-2012, 02:50 AM
I don't really think that they have time to answer tickets now. The best we can do is to wait.
Posted by alnitech, 02-26-2012, 03:01 AM
after 2 hours of downtime got an e-mail: At approximately 23:37 on 2/25/2012 Immedion Asheville experienced an unexpected event on one of its edge routers. At this time the Network Engineering team is working to resolve the issue. We will give you further updates as they become available.
Posted by Warpline, 02-26-2012, 03:38 AM
I feel like I've given them the benefit of the doubt repeatedly. Now it's just getting stupid. We're headed towards hour 3 and still don't have any hope in sight. Netriplex might have had some problems here and there, but it was never every couple months for hours at a time. I thought it was coincidence at first, but lately I'm not thinking so. I hate to say it, but other providers are starting to be an option that I don't want to take.
Posted by brc_csf, 02-26-2012, 03:59 AM
Still having problems. What about you?
Posted by Kingfish85, 02-26-2012, 03:59 AM
From what I was told, it's an edge router problem. I've got some acocunts with Eleven2. They were having problems on Friday and were down for roughly 2 hours.
Posted by brc_csf, 02-26-2012, 04:00 AM
100% down again.
Posted by Warpline, 02-26-2012, 04:02 AM
Apparently rebooting 7 times didn't fix it.
Posted by gone-afk, 02-26-2012, 04:02 AM
yes, 3h 15m now.
Posted by Warpline, 02-26-2012, 04:16 AM
It looks like things are recovering now. Knock on wood.
Posted by Warpline, 02-26-2012, 04:19 AM
Or not... Spoke too soon it appears.
Posted by Kingfish85, 02-26-2012, 04:26 AM
F5 F5 F5 F5 F5 F5....proceed to hit monitor with the keyboard.
Posted by turbovps, 02-26-2012, 04:30 AM
Another cisco bug in their network???
Posted by bhavicp, 02-26-2012, 05:14 AM
Yay - all fixed.
Posted by turbovps, 02-26-2012, 05:21 AM
What was the total downtime?
Posted by bhavicp, 02-26-2012, 05:22 AM
Approx 4 hours? I disabled my alerts though as I kept getting emails/txts every 10 minutes.
Posted by pubcrawler, 02-26-2012, 07:51 AM
Someone needs to grab Immedion/Netriplex by the horns and ride them around. How does a single edge router failing take your entire facility offline? Answer: you only have one edge router being used or Answer: failover mechanisms are broken/inadequate This is at least the 3rd if not 4th total outage of multiple hours at that facility in under two years. This is from the Uberbandwidth page which still is used as sales/promo tool I believe. Bears 2012 copyright and pages have been modified in recent months: Network Availability 100% network availability Network Performance Less than 5ms latency to the Internet Less than 1% packet loss to the Internet Support Less than 5 minutes to answer your support call Less than 60 minutes to resolve your issue ------------- Sad to hear that SLA and pricing has increased severely also. Immedion said they would adhere to existing pricing (at least for existing clients). 9x cost for a SLA? What a joke. Just take that 9x cost and place equipment in 2-3 other facilities. Jokers can't even meet their SLA. Folks spending big money down there need to look at whatever paperwork they have and start forcing refunds and getting out of contracts if need be. Less than 5ms latency to the Internet Less than 1% packet loss to the Internet I know for a fact that Asheville can't get to the internet in 5ms. Takes longer than that to exit the building and head to Atlanta for the internet. Glad I've left that facility.
Posted by brc_csf, 02-26-2012, 08:59 AM
Where did you find this info about increasing cost 9x to keep SLA? What about clients with 3 year contract and 100% SLA? I am glad we did not add more racks there.
Posted by pubcrawler, 02-26-2012, 09:16 AM
The 9x SLA was posted in this thread. I assume it's factual, although everyone isbe free to inquire and validate that. Even if costs stayed the same as they were, the SLA and upfront marketing don't agree with each other. One router wetting the bed should maybe add latency or muck up routing. It shouldn't kill the facility (again). One router = single homed. All those providers they have previously claimed to have, those are in some mix of peering in Atlanta, not on site (obviously). Hard for me to understand how so many smart business folks have gone along with this facility for so long without the tough questions being answered adequately.
Posted by Eleven2 Hosting, 02-26-2012, 10:47 AM
I got the following notifications: 12:59AM CST 2:11AM CST 3:01AM CST
Posted by alnitech, 02-26-2012, 01:11 PM
Ask them for a new quote. They have new pricing policy now.
Posted by alnitech, 02-26-2012, 02:29 PM
They are asking $9 per MEGABIT of internet now. ridiculous...
Posted by Warpline, 02-26-2012, 02:32 PM
Screenshot/URL or it didn't happen.
Posted by turbovps, 02-26-2012, 02:40 PM
Wonder why netriplex.com and uberbandwidth.com hosted on colo4dallas and cloudflare network? So they can be reached in case of downtime? canonical name www.netriplex.com. aliases addresses 72.249.147.141 Domain Whois record Queried whois.internic.net with "dom netriplex.com"... Domain Name: NETRIPLEX.COM Registrar: GODADDY.COM, LLC Whois Server: whois.godaddy.com Referral URL: http://registrar.godaddy.com Name Server: NS1.NETRIPLEX.COM Name Server: NS2.NETRIPLEX.COM Name Server: NS4.NETRIPLEX.COM Status: clientDeleteProhibited Status: clientRenewProhibited Status: clientTransferProhibited Status: clientUpdateProhibited Updated Date: 25-jan-2012 Creation Date: 18-nov-2002 Expiration Date: 18-nov-2019 >>> Last update of whois database: Sun, 26 Feb 2012 18:33:12 UTC <<< Queried whois.godaddy.com with "netriplex.com"... Registrant: Netriplex Media Solutions, LLC Box 2288 Skyland, North Carolina 28776 United States Registered through: Go Daddy Domain Name: NETRIPLEX.COM Created on: 18-Nov-02 Expires on: 18-Nov-19 Last Updated on: 25-Jan-12 Administrative Contact: Manager, IT itmanager@netriplex.com Netriplex Media Solutions, LLC Box 2288 Skyland, North Carolina 28776 United States +1.8286508521 Fax -- Technical Contact: Manager, IT itmanager@netriplex.com Netriplex Media Solutions, LLC Box 2288 Skyland, North Carolina 28776 United States +1.8286508521 Fax -- Domain servers in listed order: NS4.NETRIPLEX.COM NS1.NETRIPLEX.COM NS2.NETRIPLEX.COM Network Whois record Queried whois.arin.net with "n ! NET-72-249-147-128-1"... NetRange: 72.249.147.128 - 72.249.147.255 CIDR: 72.249.147.128/25 OriginAS: NetName: COLO4-NETRIPLEX-052708 NetHandle: NET-72-249-147-128-1 Parent: NET-72-249-0-0-1 NetType: Reassigned RegDate: 2008-05-27 Updated: 2008-05-27 Ref: http://whois.arin.net/rest/net/NET-72-249-147-128-1 CustName: Netriplex, LLC Address: 100 Technology Drive City: Asheville StateProv: NC PostalCode: 28803 Country: US RegDate: 2008-05-27 Updated: 2012-01-11 Ref: http://whois.arin.net/rest/customer/C01941192 OrgTechHandle: CAR72-ARIN OrgTechName: Colo4 ARIN Requests OrgTechPhone: +1-314-965-2020 OrgTechEmail: abuse@colo4.net OrgTechRef: http://whois.arin.net/rest/poc/CAR72-ARIN OrgAbuseHandle: CAR72-ARIN OrgAbuseName: Colo4 ARIN Requests OrgAbusePhone: +1-314-965-2020 OrgAbuseEmail: abuse@colo4.net OrgAbuseRef: http://whois.arin.net/rest/poc/CAR72-ARIN DNS records name class type data time to live www.netriplex.com IN A 72.249.147.141 60s (00:01:00) netriplex.com IN TXT v=spf1 a:corp.netriplex.com a:mail4.netriplex.com ip4:66.219.16.0/27 ip4:208.69.228.32/27 include:intuit.com, outlook.com ?all 3600s (01:00:00) netriplex.com IN TXT MS=ms83701563 3600s (01:00:00) netriplex.com IN MX preference: 50 exchange: mail008.netriplex.com 300s (00:05:00) netriplex.com IN MX preference: 10 exchange: mail007.netriplex.com 300s (00:05:00) netriplex.com IN NS ns4.netriplex.com 5184000s (60.00:00:00) netriplex.com IN NS ns1.netriplex.com 5184000s (60.00:00:00) netriplex.com IN NS ns2.netriplex.com 5184000s (60.00:00:00) netriplex.com IN A 72.249.147.141 60s (00:01:00) netriplex.com IN SOA server: ns1.netriplex.com email: itmanager.netriplex.com serial: 2012021504 refresh: 1200 retry: 600 expire: 1209600 minimum ttl: 3600 259200s (3.00:00:00) 141.147.249.72.in-addr.arpa IN PTR cloudleverage.com 300s (00:05:00) Traceroute Tracing route to www.netriplex.com [72.249.147.141]... hop rtt rtt rtt ip address fully qualified domain name 1 1 1 1 70.84.211.97 61.d3.5446.static.theplanet.com 2 1 0 0 70.87.254.1 po101.dsr01.dllstx5.networklayer.com 3 1 0 0 70.85.127.105 po51.dsr01.dllstx3.networklayer.com 4 0 0 0 173.192.18.224 ae16.bbr01.eq01.dal03.networklayer.com 5 1 0 0 206.223.118.74 equinix-dal.suddenlink.net 6 0 0 0 173.219.246.93 173-219-246-93-link.sta.suddenlink.net 7 1 0 0 206.123.64.77 8 1 0 0 72.249.147.141 cloudleverage.com canonical name uberbandwidth.com. aliases addresses 199.27.134.39 173.245.60.112 Domain Whois record Queried whois.internic.net with "dom uberbandwidth.com"... Domain Name: UBERBANDWIDTH.COM Registrar: GODADDY.COM, LLC Whois Server: whois.godaddy.com Referral URL: http://registrar.godaddy.com Name Server: EVA.NS.CLOUDFLARE.COM Name Server: MATT.NS.CLOUDFLARE.COM Status: clientDeleteProhibited Status: clientRenewProhibited Status: clientTransferProhibited Status: clientUpdateProhibited Updated Date: 10-nov-2011 Creation Date: 04-jun-2008 Expiration Date: 04-jun-2015 >>> Last update of whois database: Sun, 26 Feb 2012 18:35:28 UTC <<< Queried whois.godaddy.com with "uberbandwidth.com"... Registrant: Uber Bandwidth, LLC Box 2288 Skyland, North Carolina 28776 United States Registered through: Go Daddy Domain Name: UBERBANDWIDTH.COM Created on: 04-Jun-08 Expires on: 04-Jun-15 Last Updated on: 10-Nov-11 Administrative Contact: Master, Host itmanager@uberbandwidth.com Uber Bandwidth, LLC Box 2288 Skyland, North Carolina 28776 United States +1.8889298237 Fax -- Technical Contact: Master, Host itmanager@uberbandwidth.com Uber Bandwidth, LLC Box 2288 Skyland, North Carolina 28776 United States +1.8889298237 Fax -- Domain servers in listed order: EVA.NS.CLOUDFLARE.COM MATT.NS.CLOUDFLARE.COM Network Whois record Queried whois.arin.net with "n 199.27.134.39"... NetRange: 199.27.128.0 - 199.27.135.255 CIDR: 199.27.128.0/21 OriginAS: AS13335 NetName: CLOUDFLARENET NetHandle: NET-199-27-128-0-1 Parent: NET-199-0-0-0-0 NetType: Direct Assignment RegDate: 2010-08-19 Updated: 2011-04-19 Ref: http://whois.arin.net/rest/net/NET-199-27-128-0-1 OrgName: CloudFlare, Inc. OrgId: CLOUD14 Address: 665 Third Street #207 City: San Francisco StateProv: CA PostalCode: 94107 Country: US RegDate: 2010-07-09 Updated: 2011-11-03 Comment: http://www.cloudflare.com/ Ref: http://whois.arin.net/rest/org/CLOUD14 OrgTechHandle: ADMIN2521-ARIN OrgTechName: Admin OrgTechPhone: +1-650-319-8930 OrgTechEmail: admin@cloudflare.com OrgTechRef: http://whois.arin.net/rest/poc/ADMIN2521-ARIN OrgNOCHandle: NOC11962-ARIN OrgNOCName: NOC OrgNOCPhone: +1-650-319-8930 OrgNOCEmail: noc@cloudflare.com OrgNOCRef: http://whois.arin.net/rest/poc/NOC11962-ARIN OrgAbuseHandle: ABUSE2916-ARIN OrgAbuseName: Abuse OrgAbusePhone: +1-650-319-8930 OrgAbuseEmail: abuse@cloudflare.com OrgAbuseRef: http://whois.arin.net/rest/poc/ABUSE2916-ARIN RAbuseHandle: ABUSE2916-ARIN RAbuseName: Abuse RAbusePhone: +1-650-319-8930 RAbuseEmail: abuse@cloudflare.com RAbuseRef: http://whois.arin.net/rest/poc/ABUSE2916-ARIN RTechHandle: ADMIN2521-ARIN RTechName: Admin RTechPhone: +1-650-319-8930 RTechEmail: admin@cloudflare.com RTechRef: http://whois.arin.net/rest/poc/ADMIN2521-ARIN RNOCHandle: NOC11962-ARIN RNOCName: NOC RNOCPhone: +1-650-319-8930 RNOCEmail: noc@cloudflare.com RNOCRef: http://whois.arin.net/rest/poc/NOC11962-ARIN DNS records name class type data time to live www.uberbandwidth.com IN CNAME uberbandwidth.com 300s (00:05:00) uberbandwidth.com IN NS eva.ns.cloudflare.com 86400s (1.00:00:00) uberbandwidth.com IN NS matt.ns.cloudflare.com 86400s (1.00:00:00) uberbandwidth.com IN MX preference: 10 exchange: mail.uberbandwidth.com 300s (00:05:00) uberbandwidth.com IN A 173.245.60.112 300s (00:05:00) uberbandwidth.com IN SOA server: eva.ns.cloudflare.com email: dns.cloudflare.com serial: 2012020915 refresh: 10000 retry: 2400 expire: 604800 minimum ttl: 3600 86400s (1.00:00:00) uberbandwidth.com IN A 199.27.134.39 300s (00:05:00) 39.134.27.199.in-addr.arpa IN PTR cf-199-27-134-39.cloudflare.com 1800s (00:30:00) Traceroute Tracing route to www.uberbandwidth.com [199.27.134.39]... hop rtt rtt rtt ip address fully qualified domain name 1 1 1 1 70.84.211.97 61.d3.5446.static.theplanet.com 2 0 0 0 70.87.254.5 po101.dsr02.dllstx5.networklayer.com 3 0 0 0 70.85.127.109 po52.dsr02.dllstx3.networklayer.com 4 0 0 0 173.192.18.230 ae17.bbr02.eq01.dal03.networklayer.com 5 1 0 0 157.238.224.229 ae-11.r01.dllstx04.us.bb.gin.ntt.net 6 2 5 2 69.31.63.174 xe-5-0-6.ar1.dfw1.us.nlayer.net 7 1 0 0 69.31.63.182 as13335.xe-4-0-5.ar1.dfw1.us.nlayer.net 8 1 0 1 199.27.134.39 cf-199-27-134-39.cloudflare.com Trace complete
Posted by pubcrawler, 02-26-2012, 02:40 PM
Is this $9 per megabit on small order commits (i.e. under 20)? $9 per megabit (looks at the calendar, nope it's not April 1st). Guess we have an early celebration of February fools with that pricing. So a 100Mbps connection by their pricing is $900 This *was* their pricing for bandwidth: 100 Mbps Dedicated/Unmetered - $400/month 1 Gig Dedicated/Unmetered - $1500/month 10 Gig Dedicated/Unmetered - $10,000/month So that's more than more than doubling of cost, if so. No-commit pricing was $4.99 per Mbps. So $5 vs $9 now or 45%+ increase.
Posted by alnitech, 02-26-2012, 02:51 PM
We asked them to give us a quote for a new pricing. They just multiplied our average bandwidth usage in Mbps x9 + 650 per rack + 350 per 30A 110V. I am glad that we have 2 years contract and we have a time to move out of this facility. Obviously they don't longer work with "web hosting" colo clients. Looks like they are targeting banks and other companies with giga $ revenues. We should discuss it in a new thread.
Posted by brc_csf, 02-26-2012, 03:03 PM
I believe Netriplex works with 3 or 4 facilities and just Asheville's one is owned. So, they have lot of options to host their sites.
Posted by qps, 02-26-2012, 04:51 PM
Just a guess, but it appears that they didn't sell the brands Netriplex or Uberbandwidth with the facilities in Asheville.
Posted by pubcrawler, 02-26-2012, 05:11 PM
Talk about confusion. So Netriplex is still it's own brand, and selling space in the same facility? Mega odd. The customers that are now Immedion's should call Netriplex/Uberbandwidth and sign up for service with them in the same facility. A mass customer defection That facility has always been seemingly intentionally deceptive and unclear about things. $1k for a rack + 30A and $9/Mbps @ 100Mbps = $1900/mo that's 200% increase over Netriplex rate of $999/mo for same space with 20A and 1Gbps. Folks should definitely start a thread to discuss this.
Posted by bhavicp, 02-26-2012, 05:13 PM
Confirmed by my rep a while ago that Uberbandwidth wasn't sold with the facility. But unsure about Netriplex..
Posted by pubcrawler, 02-26-2012, 05:14 PM
Netriplex doesn't list Asheville on it's facilities list: http://www.netriplex.com/solutions/server_colocation/ Says on their contact form: "We no longer offer colocation in Asheville, North Carolina, but we have many other facilities around the country to choose from." Folks unfamiliar with Asheville, should start looking for instance in Atlanta (where Ashville traffic actually routes to get to the internet). Several folks offering good prices on full racks in Atlanta. Better get to moving now before the crowd clogs up the roadways and saturates vendors specializing in moving gear for folks. Last edited by pubcrawler; 02-26-2012 at 05:22 PM.
Posted by alnitech, 02-26-2012, 06:41 PM
I know some hosts where offering things like 100TB on 1G port in this facility so they are out of a game in this case. It is question of trust. Classical bait and switch. CORRECTION: Lets say Immedion not Netriplex. Last edited by alnitech; 02-26-2012 at 06:46 PM.