Can we please get an update about the residual impacts of the datacenter outage?

Desiato

ZOS_MattFiror wrote:

Hey everyone, I wanted to update everyone that we are recovering from the most severe system outage in ten years of ESO. Thank you all for being patient as we recover from this near worst case scenario where one of our datacenters lost all power for the first time ever. We will be dealing with the internal ramifications of this for weeks, but for now, all public live Realms are back online. I want to also extend thanks and gratitude to the many (many!) people at ZOS who have pitched in on 24-hour schedules to right the ship. This work continues, and shows the dedication and extreme pride in ESO that everyone at ZOS holds dear.

https://forums.elderscrollsonline.com/en/discussion/670628/datacenter-follow-up

Many players believe we've been experiencing server performance issues since the datacenter outage referenced above, especially after the event began.

I notice it in PVE instances of all kinds, but especially trials when a block, roll dodge or ability doesn't register. I notice it is common to be stuck in combat for a little longer after a fight ends. There are also freezes and rubberbanding, even in 4 player instances.

I've been pinging the ip address zos provides for troubleshooting gameplay issues (198.20.200.1) and the avg ping is around 50ms with no packet loss or spikes that correspond with the in-game lag I am experiencing.

Have we been experiencing residual effect of the datacenter outage? If so, when can we expect these issues to be resolved?

@ZOS_Kevin

moderatelyfatman

I suspect everyone is on holiday for another week or six.

WhiteCoatSyndrome

moderatelyfatman wrote: »

I suspect everyone is on holiday for another week or six.

Yup. They’re supposed to be back after New Year.

React

Yep, I've been having issues that I have never once experienced in the history of the game since the outage. Namely the game is frequently freezing, then rubberbanding moments later. This same exact problem is happening to a number of other players I've spoken, as well as several content creators (juggy, imperial).

Never had these problems prior to the datacenter outage. Really hope they acknowledge this ASAP when they're back in the office, presumably after new years. The game is as good as unplayable for me.

Here is a thread with some videos of the issue I'm referring to.

https://forums.elderscrollsonline.com/en/discussion/670960/pc-na-constant-game-freezes#latest

Desiato

I truly hope ZOS staff are enjoying their vacations.

However, for their customers to better enjoy their time off work, we would very much appreciate an update about clear performance issues that seem be affecting everyone.

Even if it can't be immediately remedied, it's easier for many to deal with if they at least have an understanding of the issue.

OR maybe it has nothing to do with the datacenter issue and there's something that needs to and can be fixed immediately and they just don't know about it yet.

Either way, this issue deserves quick attention.

virtus753

Jessica mentioned that they also took measures in response to “malicious activity” that she said would impact performance, separately from the outage.

https://forums.elderscrollsonline.com/en/discussion/comment/8238380#Comment_8238380

So there is more going on, and they’ve acknowledged it. Hopefully we’ll get some follow up after the holidays.

edward_frigidhands

virtus753 wrote: »

Jessica mentioned that they also took measures in response to “malicious activity” that she said would impact performance, separately from the outage.

https://forums.elderscrollsonline.com/en/discussion/comment/8238380#Comment_8238380

So there is more going on, and they’ve acknowledged it. Hopefully we’ll get some follow up after the holidays.

Are these measures still active?

virtus753

edward_frigidhands wrote: »

virtus753 wrote: »

Jessica mentioned that they also took measures in response to “malicious activity” that she said would impact performance, separately from the outage.

https://forums.elderscrollsonline.com/en/discussion/comment/8238380#Comment_8238380

So there is more going on, and they’ve acknowledged it. Hopefully we’ll get some follow up after the holidays.

Are these measures still active?

As I said, that is something they should follow up on when they get back from the holidays, as the measures are either still in place or were disabled without a proper comment. We won’t know without further information. What we do know is that they were put in place and were said to be likely to hurt performance. That’s in addition to any aftereffects from the outage and to the normal stress from an event, which typically hurts performance in very noticeable ways as well.

We also know ZOS currently has lower staffing due to the holidays, which leaves a game and its community more vulnerable to the effects of said malicious activity, so it wouldn’t surprise me if the measures were still in place to try to forestall any further issues until everyone’s back to handle anything that arises.

Desiato

Whatever the case is, it would be nice to have the very recent issues acknowledged with assurances they know what it is and how to resolve it.

I feel the performance issues have killed Trials during the holidays. There aren't as many open and group finder trials running as I expected, and I have a presence in a lot of trial communities to give me some perspective. One RL in particular I knew who had planned to run Trials over the holidays decided it's not worth the trouble.

I was in a vCR group that had to call it early last night despite a strong group comp because some players had recurring disconnects while most others had intermittent performance issues like freezing followed by rubber banding.

Then it got worse when I made the mistake of doing a 3 dps vdsa run. Though I knew the other players had an understanding of the performance issues affecting ESO, it was still embarrassing to die to lag a few times, which happened to all four of us.

Thrasher91604

It definitely needs a follow-up by ZoS.

Server performance has been very bad since since the data center shutdown and it's after the recovery.

I am experiencing bad lag in PvE and Cyrodiil areas, as well as a few daily crashes in both areas.

Rkindaleft

I just finished watching my partner play in the background and half their trial group had a rubberband at the same time and a couple of them got disconnected afterwards - these issues have been going on for nearly 3 weeks now ever since the server outage.

I’ve posted this in a different thread before but this is exactly the same thing that was happening to us in Dreadsail a week ago, this rubberband affected nearly everyone in the group and a number of people got kicked off after it finished. I understand people may still be on holidays, but we really need some communication about this because any instanced PvE is pretty much unplayable.

https://youtu.be/AdxZsPtXDfY?si=3Wd8SJHligoxKkZ5

Amottica

moderatelyfatman wrote: »

I suspect everyone is on holiday for another week or six.

And it is known. It is a pinned message informing us all. I doubt any response we will get this week would be very informative.

silky_soft

I don't think we are running on the same servers and network hardware as before. The lag is crazy, it's all over the shop. There is no consistency.

Desiato

A member of the vdsa group I mentioned earlier described it best: "I feel like I'm in Cyrodiil!"

This is obviously more than a ddos as there are clear signs of server processing lag and bottlenecks.

Aurielle

Desiato wrote: »

A member of the vdsa group I mentioned earlier described it best: "I feel like I'm in Cyrodiil!"

This is obviously more than a ddos as there are clear signs of server processing lag and bottlenecks.

I said those exact words…back in May, when these problems first started happening to me while I was CRAFTING WRITS in Rawl Kha, of all things.

We definitely need some answers… is ESO running on the same servers it was running on pre-outage? What caused the outage in the first place? If ESO is indeed still running on the same servers, are the post-outage latency / disconnect problems related to the same problems a number of us started experiencing after that patch maintenance back in May?