awww the rabbit hole would of been fun on that one.

Just figured out everything guys! Did some research into level 3 and turns out the president of the company's name is Molag Bal! Can't believe we didn't see this coming!!

Soulsix wrote: »

Listatta wrote: »

Kinnahz wrote: »

illuminati confirmed

I so want you to expound on that statement

As far as one liners go, was on key and on time id say lol

thank you sir.

Listatta, No need for explanation when the illuminati is involved

i think everyone missed the post where they said servers were up lol

Runs wrote: »

My only gripe in all this is that there isn't an official locked thread with updates from ZOS. Yeah I can read the thing at the top of the screen but that doesn't tell me everything. Someone who hasn't been around for the last 8 hours isn't going to want to read 39 pages just to see the ZOS comments.

It would just be nice to be able to read about the issues without all the constant bickering between players.

If a thread has the Z symbol indicating a moderator response, you can click on that and it will take you to the first moderator response. Then there will be arrows like so <> and you can click > and it will take you to the next moderator response. And so on and so forth.

You already don't have to read the whole thing, it's set up just the way you want

Enodoc wrote: »

Alcast wrote: »

Its a Trap! ANd the EU server is Located in Germany, why is it down? >:>

@Alcast The ISP had a worldwide outage for a time last night. Now that the ISP is coming back online, ZOS have to do a system-wide maintenance to check all the servers.

Ok thx

SeptimusDova wrote: »

Gina thank you so much for your dedication to the playerbase.

Solar storms at levels g4 and g5 are disruptive to backhaul circuits. Any DS3 or higher Microwave path is a feedpoint into the system. I am very tired my friends so I will post the graphs. I will answer any questions pertaining to solar weather after I rest. On the graphs you will see K4 which coincides with NOAA and NASA and GOES.

UrQuan do you work backhaul?

K index


7 day indice below




When High frequency radio is mentioned that is referring to 1.8-30Mhz radio traffic.

Backhaul and space diversity systems and wave-guide systems with degraded magnetic isolators can act as transmission paths for voltage induced by Solar variances. waveguide to radio, radio to mux, mux to bes56, bes 56 to CLN. Its been awhile since I was in a NOC or a backhaul site. Some .gov sites we hardened to help prevent damage to equipment. Running spares often became an issue due to tired techs and contractors trying to adhere to the five 9's. Parts would be used and not annotated as such. the used were put back in a box and would not be turned in on time. Which created problems. The wiltel FAA site in AZ had this issue on 2004 and so did the riverside site. Level3 com. I am not sure how they handle their operations.

Supply voltage side on some sites were filtered and regulated via DC. But that is not the topic of this thread. I feel sorry for the affected companies and for the providers. If indeed their systems were damaged it can get expensive. Even more so if they were running any old Nortel systems.

I've been working in industry a long time & while I understand some of what you are saying can you clarify a few things?
Personally I can't remember a single outage on the carrier level due to "solar disturbance".
Are there notes on this happening or happening frequently at various locations?
You state "are disruptive to backhaul circuits", are there not multiple pathways & failovers? Is there no redundancy? (both on the carrier side & ZOS's side)

Traditionally, many larger companies have multiple carriers so if Verizon goes down, AT&T is still up & vice versa; you just have to reroute the traffic & everything still works.

I'm sure everyone would like to believe that ZOS has their own data center but more than likely they have probably rented/leased a co-location aka colo so they don't own the location or the (internet) pipe coming in, they may not even own the servers, & definitely don't own the infrastructure which SHOULD contain multiple ISP's with failover & redundant paths which baffles me why it apparently doesn't due to us being down.

This makes troubleshooting a bit of a pain (as it's a vendor contacting a vendor contacting a vendor contacting...you get the point) but drastically cuts cost for them as they don't have to pay 24/7 staff for support. Instead they enter a contract with the on-site services people where ZOS may pay for added support. This will allow them to not be responsible & yet hold someone else accountable during an outage. This is fairly standard industry practice, is one of the things I really hate & think sucks about the industry.

Per the level 3 outage map that was posted earlier, and assuming the information of the servers being in Texas is correct, it shows issues being in Austin & Plano currently.

The OC-whatever & DS-whatever lines that are running underneath are just cabling right? So the cabling shouldn't be affected, it should just be the circuitry in the telco room at the colo & that room should be shielded by being a metal room or something that would not be conductive/affected by the "solar disturbance".

qpviper1qp wrote: »

Just figured out everything guys! Did some research into level 3 and turns out the president of the company's name is Molag Bal! Can't believe we didn't see this coming!!

Now you will go blind, age 30 years and live in a cave talking to chosen ones. Have fun with that. On the bright side you'll meet three cool companions and a weird English dude.

It's 8pm In Australia on a Friday night, damn not a good time for this to happen lol

Hopefully everything is OK and it's not something like that PSN outage years ago where it was down for months

Arrived at the office at 8am (UK). Have finally managed to catch up with every post (11.42am) in this thread, dishing out Awesomes and Agrees left right and center.

Ok, let's start working.

Ohhh .. There's another thread on the megaserver issue!

ViscousSummer88 wrote: »

at the end of the day Level 3 are not the only supplier, the data centre they use is not the only data centre.

For all intents and purposes in that area Level3 IS the only supplier, they own a large majority of the Backbone network, and almost all internet traffic in that area goes through them no matter which ISP you use, it wouldn't matter whether ZOS uses AT&T, Verizon, ComCast or any other provider, they all go through Level3's network. So no they don't really have a choice in the matter.

Relaterd a word?

Thanks for the updates @ZOS_MichaelServotte @ZOS_GinaBruno especially Gina.
Sweet dreams.
See you tonight.

Not only did it happen once but twice to us! @ZOS really needs to pay their damn electric bill....