Booted from PCNA now logon Q

Jimbru · February 6

PCNA. With repeated login attempts, sometimes I get as far as character selection and then get dropped; sometimes I can't get past the login server at all. I've gotten Error 200 as well. Given that it sometimes kinda works and sometimes doesn't, I'm not sure if the issue is PCNA itself, the login server, or something blinky in the handshake in between.

DenverRalphy · February 6

RicAlmighty wrote: »

DenverRalphy wrote: »

RicAlmighty wrote: »

sarahthes wrote: »

nihonseanb14_ESO wrote: »

Several boots in a row. Looks like they broke something when they worked on the databases. 1 step forward, 3 steps back.

Database issues don't cause disconnects. This is a connectivity issue, probably at their end.

Crashes cause disconnects. If the server side processes are crashing, that will disconnect every player currently connected to that instance. That is almost certainly what is happening here.

Crashes cause complete shutdowns. Players are still getting back in, only to be disco'd again minutes later.

This is likely a DDOS attack. Happens pretty regularly whenever gaming servers announce they're performing "upgrade maintenance".

Players aren't logging back into the same server instance that crashed, I would have thought that was obvious. At any given time there are many separate server instances running with a maximum number of players connected to each one. If it crashes, then the players connected to that instance are immediately dropped. This does not cause a shutdown unless it's the operating system itself which crashes, which is highly unlikely.

This could be a DDos attack, but if it is that speaks even more poorly of the infrastructure as there are ways to mitigate invalid traffic requests. Handling DDos attacks is not a new thing, companies have been dealing with it for over 20 years and there are pretty standard mitigation tactics, provided that they are actually put in place that is.

Players aren't logging back in now, because it has escalated. However initially players actually were getting back in (I know this because I was one of them), only to be dropped again a few minutes later.

sarahthes · February 6

RicAlmighty wrote: »

DenverRalphy wrote: »

RicAlmighty wrote: »

sarahthes wrote: »

nihonseanb14_ESO wrote: »

Several boots in a row. Looks like they broke something when they worked on the databases. 1 step forward, 3 steps back.

Database issues don't cause disconnects. This is a connectivity issue, probably at their end.

Crashes cause disconnects. If the server side processes are crashing, that will disconnect every player currently connected to that instance. That is almost certainly what is happening here.

Crashes cause complete shutdowns. Players are still getting back in, only to be disco'd again minutes later.

This is likely a DDOS attack. Happens pretty regularly whenever gaming servers announce they're performing "upgrade maintenance".

Players aren't logging back into the same server instance that crashed, I would have thought that was obvious. At any given time there are many separate server instances running with a maximum number of players connected to each one. If it crashes, then the players connected to that instance are immediately dropped. This does not cause a shutdown unless it's the operating system itself which crashes, which is highly unlikely.

This could be a DDos attack, but if it is that speaks even more poorly of the infrastructure as there are ways to mitigate invalid traffic requests. Handling DDos attacks is not a new thing, companies have been dealing with it for over 20 years and there are pretty standard mitigation tactics, provided that they are actually put in place that is.

I can't imagine a company owned by Microsoft would be defenseless. They've mentioned their mitigation in the past and that it can be a bit rough as it kicks in.

LadyGP · February 6

sarahthes wrote: »

RicAlmighty wrote: »

DenverRalphy wrote: »

RicAlmighty wrote: »

sarahthes wrote: »

nihonseanb14_ESO wrote: »

Several boots in a row. Looks like they broke something when they worked on the databases. 1 step forward, 3 steps back.

Database issues don't cause disconnects. This is a connectivity issue, probably at their end.

Crashes cause disconnects. If the server side processes are crashing, that will disconnect every player currently connected to that instance. That is almost certainly what is happening here.

Crashes cause complete shutdowns. Players are still getting back in, only to be disco'd again minutes later.

This is likely a DDOS attack. Happens pretty regularly whenever gaming servers announce they're performing "upgrade maintenance".

Players aren't logging back into the same server instance that crashed, I would have thought that was obvious. At any given time there are many separate server instances running with a maximum number of players connected to each one. If it crashes, then the players connected to that instance are immediately dropped. This does not cause a shutdown unless it's the operating system itself which crashes, which is highly unlikely.

This could be a DDos attack, but if it is that speaks even more poorly of the infrastructure as there are ways to mitigate invalid traffic requests. Handling DDos attacks is not a new thing, companies have been dealing with it for over 20 years and there are pretty standard mitigation tactics, provided that they are actually put in place that is.

I can't imagine a company owned by Microsoft would be defenseless. They've mentioned their mitigation in the past and that it can be a bit rough as it kicks in.

To be fair.... I'm pretty sure MS just takes a cut of the profits. It's not like M S came in and just flooded the zone with resources so to speak.

Desiato · February 6

Honestly, I'm not trying to give ZOS a hard time, but really when widespread issues like this happen, the service provider *really* should be the first to realize it because of the high level view they're supposed to have.

I say this because if such a capability doesn't exist, it's low hanging fruit that should be considered.

RicAlmighty · February 6

[Removed]

DinoZavr · February 6

PC/NA same issues.
logon. placed into a queue.
wait. select character. play for 10 .. 20 minutes
abruptly disconnected

logon again. placed into a queue.
wait. select character. play for about 10 minutes
abruptly disconnected
then the sequence repeats again and again.

Dear @ZOS, PC/NA is unplayable. Please, fix that.

ZOS_Kevin · February 6

Hi all, we think we have the issue figured out and populations are starting to recover. We are monitoring things as well.

IsharaMeradin · February 6

ZOS_Kevin wrote: »

Hi all, we think we have the issue figured out and populations are starting to recover. We are monitoring things as well.

Thank you for looking into the situation. Will give it a test and see what happens.

Chibicosmos · February 6

Xbox NA keep crashing when I interact with nodes

averyfarmanb14_ESO · February 6

ZOS_Kevin wrote: »

Hi all, we think we have the issue figured out and populations are starting to recover. We are monitoring things as well.

Looks much better. No queue, client loaded quickly enough - looks good. Thanks for following up!

Squeex · February 6

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

karthrag_inak · February 6

Khajiit thinks perhaps a Muskrat got into the server farm

Wolfshade · February 6

I know the players didnt want it to hear, but it was the first time got booted that way from server.

Yes, after Yesterday, Eso didnt run as well as known. Stuttering, Lags and so on. For me i still belive, that it should be possible that the problem caused by own system/network/ etc. I thought bout it i didnt did it today after maintenance yesterday, but in most cases and in combination with Eso`s Troubleshoot-Help (restart/ clean newstart from my system and modem) this helped me many times:

"Reset IP and clear DNS cache
1. Click "Search" in Windows bar and type "cmd".
2. Right click and select "Run as administrator" and "Yes".
3. Type the following commands:

Type netsh winsock reset and select Enter.
Type netsh int ip reset and select Enter.
Type ipconfig /release and select Enter.
Type ipconfig /renew and select Enter.
Type ipconfig /flushdns and select Enter.

ZOS_Kevin · February 6

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

Jimbru · February 6

ZOS_Kevin wrote: »

Hi all, we think we have the issue figured out...

Translation: they smacked the casing with a blunt object and did a hard reboot.

RicAlmighty · February 6

[Removed]

Squeex · February 6

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation.

Oof. OT for all I suppose (if applicable). I appreciate the response and I wish you all the best of luck.

imaslowlearner · February 6

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

ESO didn't have consistent attacks before it was acquired by microsoft. Are these vulnerabilities caused by microsoft's security? If microsoft is to blame for the vulnerabilities could you possibly look into what amazon or apple does to prevent cyberattacks without crippling the game?

TX12001rwb17_ESO · February 6

And just crashed with error has occured.

TX12001rwb17_ESO · February 6

And just crashed again with the same error has occurred not 4 minutes later.

DrOctopu5 · February 7

Still happening, booted like 5 times earlier and it just happened again.

Instant fail to the login screen during combat.

baltic1284 · February 7

ZOS_Kevin wrote: »

Hi all, we think we have the issue figured out and populations are starting to recover. We are monitoring things as well.

Another problem I have seen and have experienced is zones not loading right sound goes out parts of the UI disappear, then when you try and shut the game down the game won't shut down, and when it does and reload the same problems happens forcing you to go through it all again. My game is on Steam and it isn't Steam doing it as when the game does mess up all other games i have work just fine.

aussie500 · February 7

I also got booted from the server many times in the last 10 minutes and just give up, too much hassle trying to play ESO at the moment.

DenverRalphy · February 7

imaslowlearner wrote: »

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

ESO didn't have consistent attacks before it was acquired by microsoft. Are these vulnerabilities caused by microsoft's security? If microsoft is to blame for the vulnerabilities could you possibly look into what amazon or apple does to prevent cyberattacks without crippling the game?

Pretty sure ESO has been targeted quite often long before the Microsoft acquisition.

LadyGP · February 7

DenverRalphy wrote: »

imaslowlearner wrote: »

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

ESO didn't have consistent attacks before it was acquired by microsoft. Are these vulnerabilities caused by microsoft's security? If microsoft is to blame for the vulnerabilities could you possibly look into what amazon or apple does to prevent cyberattacks without crippling the game?

Pretty sure ESO has been targeted quite often long before the Microsoft acquisition.

Yup.

IsharaMeradin · February 7

Just wanted to say that I did log back in with my main on PCNA. Finished up my survey & treasure maps, scryed and dug up one item, and got into an IA session that lasted well into arc 4. My teammate crashed once after we were done with one of the stages. I, however, seemed to have a stable connection.

Reverb · February 7

imaslowlearner wrote: »

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

ESO didn't have consistent attacks before it was acquired by microsoft. Are these vulnerabilities caused by microsoft's security? If microsoft is to blame for the vulnerabilities could you possibly look into what amazon or apple does to prevent cyberattacks without crippling the game?

Yeah they did. There were repeated periods of ddos attacks that presented just like this, and eventually made zeni partner with Akamai. The ddos attacks really slowed down after that but added extra hops and latency to everyone’s connection.

That was years before the MS acquisition.

LadyGP · February 7

Reverb wrote: »

imaslowlearner wrote: »

ZOS_Kevin wrote: »

Squeex wrote: »

@ZOS_Kevin It's too early for an RCA, but what seems to be the issue?

We have determined that it was a malicious network attacks against the ESO service. Our teams are working to keep track of these and adapt with various types of mitigation. There will be additional ping times due to mitigation being active. Just wanted to be clear there.

ESO didn't have consistent attacks before it was acquired by microsoft. Are these vulnerabilities caused by microsoft's security? If microsoft is to blame for the vulnerabilities could you possibly look into what amazon or apple does to prevent cyberattacks without crippling the game?

Yeah they did. There were repeated periods of ddos attacks that presented just like this, and eventually made zeni partner with Akamai. The ddos attacks really slowed down after that but added extra hops and latency to everyone’s connection.

That was years before the MS acquisition.

This.

Katahdin · February 10

This happened to me this morning.
Got disconnected then put in a que to log back in which didnt connect.
Tried a couple of times and every time the estimated que time got longer and longer.
Had to leave for a couple of hours and was able to log back in when I got home.

PCNA