ZOS, Massive Spike in Ping/LAG in Recent Days - What Gives?
Maintenance for the week of March 17:
· [COMPLETE] Xbox: NA and EU megaservers for maintenance – March 19, 6:00AM EDT (10:00 UTC) - 9:00AM EDT (13:00 UTC)
· [COMPLETE] PlayStation®: NA and EU megaservers for maintenance – March 19, 6:00AM EDT (10:00 UTC) - 9:00AM EDT (13:00 UTC)
· [COMPLETE] Xbox: NA and EU megaservers for maintenance – March 19, 6:00AM EDT (10:00 UTC) - 9:00AM EDT (13:00 UTC)
· [COMPLETE] PlayStation®: NA and EU megaservers for maintenance – March 19, 6:00AM EDT (10:00 UTC) - 9:00AM EDT (13:00 UTC)
-
ISCOLDSOUL✭✭
While I understand the furstration I don't think it's fair to say they have been ignoring the issue. They have made it pretty clear they are working on it.
They ZOS changed something last May when the lag issue in PVP started, they know exactly what they did, maybe something cheaper for ZOS, I really don't know, but I'm taking an educated guess if they rolled back what they did last May the problem might disappear2 -
reazea✭✭✭✭✭
✭
They are getting DDOSed and have their mitigation turned back on which makes things much much worse (makes cyro close to unplayable for some).
Thats why it got worse IMO.
You might want to look up how simple of an attack dDoS is and how easily every major company is able to deal with them. As players we should never, ever see any performance drops due to something as simple and easy to mitigate as a dDoS attack.7 -
I've been testing my new system in the sewers and seems to be a lot more stable in terms of performance, though I do see occasional ping spikes but not as frequently as before.0 -
LadyGP✭✭✭✭✭
✭JaxontheUnfortunate wrote: »I've been testing my new system in the sewers and seems to be a lot more stable in terms of performance, though I do see occasional ping spikes but not as frequently as before.
When did you upgrade, if you don't mind me asking?LadyGP/xCatGuy
PC/NA0 -
Rogue_Coyote✭✭✭Maybe it would be a good idea to have the dev team join a cyrodiil campaign during prime time and use their server metric measuring magic during prime time lag fest. That may allow them to visually see the issues we have been reporting forever, and maybe gleam some type of usable data for a possible fix. A guy can dream6 -
Seravi✭✭✭✭✭Sigh doing daily writs, I cannot hit E to make a glyph then pow, kicked to the login screen with "An error has occurred. Please wait a few minutes to log in again."
PC NA West Weald crafting area 9:58AM CST
And now a login que....Edited by Seravi on February 10, 2025 4:01PM0 -
MagdaV✭✭Went into Coldharbour public dungeon, kicked. Tried to log back in, get queue.
PCNA
10:00AM CST0 -
LadyGP✭✭✭✭✭
✭Rogue_Coyote wrote: »Maybe it would be a good idea to have the dev team join a cyrodiil campaign during prime time and use their server metric measuring magic during prime time lag fest. That may allow them to visually see the issues we have been reporting forever, and maybe gleam some type of usable data for a possible fix. A guy can dream
Don't want to overstep much here but I will say as Kevin mentioned earlier an engineer was going to (and did) reach out to me.
I streamed multiple days of prime time fights with Pingplotter (a tool that continuously monitors your network connection while you play, identifying latency, packet loss, and routing issues) and CPU/GPU load overlay. During these tests I ran I had both add-onbs enabled and disabled.. ran grouped up with a ball group, ran out of group with ball groups, zerg surfed, ran solo, etc.
All of this was sent to them. They can then use this information from the client side and compare it against what the server is saying/seeing.
So I'd say you're not far off... they are doing that (I'm sure this isn't the first time) and are working on a fix.
Just want to be 100% clear I have no knowledge of said fix/implementation plans.. just responding to your point and saying I've sent them the info you wished they would capture. They have got it and are doing "all the things" breaking that information down.
Edited by LadyGP on February 10, 2025 4:07PMLadyGP/xCatGuy
PC/NA5 -
LadyGP✭✭✭✭✭
✭Sigh doing daily writs, I cannot hit E to make a glyph then pow, kicked to the login screen with "An error has occurred. Please wait a few minutes to log in again."
PC NA West Weald crafting area 9:58AM CST
And now a login que....Went into Coldharbour public dungeon, kicked. Tried to log back in, get queue.
PCNA
10:00AM CST
Considering you both came in at almost the same time saying the same thing I'm going to assume either this was a server wide kick or they are getting DDoSed again.LadyGP/xCatGuy
PC/NA0 -
Seravi✭✭✭✭✭
Considering you both came in at almost the same time saying the same thing I'm going to assume either this was a server wide kick or they are getting DDoSed again.
Yea console got it as well. Everyone slapped to the login screen so probably critters at it again.0 -
Cruxanero✭✭✭✭I think my whole guilds were kicked. There were a couple hundred people online before the kick, and when I cam back on there were a handful per guild left (has filled again by now).0 -
When did you upgrade, if you don't mind me asking?
In the last 1-2 weeks. Liking the new system though outside of the memory probably went a wee bit overboard for eso
Edited by JaxontheUnfortunate on February 10, 2025 4:40PM0 -
LadyGP✭✭✭✭✭
✭JaxontheUnfortunate wrote: »
In the last 1-2 weeks. Liking the new system though outside of the memory probably went a wee bit overboard for eso
Ah gotcha. Was curious timing wise as it related to the maintenance we just had. Thanks for the info and enjoy the new hardware!!!!! No better feeling than playing that first game after an upgrade.LadyGP/xCatGuy
PC/NA0 -
Ah gotcha. Was curious timing wise as it related to the maintenance we just had. Thanks for the info and enjoy the new hardware!!!!! No better feeling than playing that first game after an upgrade.
Lol yeah 0 -
SalamanNZ✭✭✭Thought I'd try a BG this morning. My character was frozen. Everyone running by even enemies. I was like a living ghost that was unable to move for over 90 seconds. I had to alt f4 to quit. Was this due to a massive desync??Edited by SalamanNZ on February 10, 2025 10:03PM0
-
Really bad lag tonight in IA, like playing a rubber band gameFOR THE PACT!!!!!0 -
Sluggy✭✭✭✭✭I decided to reinstall a few nights ago. Kinda regretting it already. I spent a little time in Cyrodiil last night and it wasn't too awful but the map also seemed devoid of life despite having a queue.
Tonight in IC was unbearable though. My latency seemed to fluctuate between 700 and something so high I couldn't tell if I was even still connected or not most of the time. I finally got booted from the game with a hard CTD after my latency spiked through the stratosphere.
EDIT:
I went back into Cyrodiil shortly after this and outside of a hammer fight or two the lag was hardly an issue at all. I give up. I'm just gonna spam my light attacks and try not to think to hard about it anymore ¯\_(ツ)_/¯Edited by Sluggy on February 11, 2025 11:11AM2 -
MrGarlic✭✭✭✭✭
✭Putting on trait research and horse training on PCEU, I get high ping 500-900ms. No point playing the game tonight.
PCNA Constant 300-400 ping here too.
Steaming pile of lag since last night's patch (10 Feb 2025)
Just did a TRACERT to the PCNA server.
6 59 ms 59 ms 59 ms et5-1-5.sebr3.global-gateway.net.nz [202.50.232.250]
7 59 ms 59 ms 61 ms 103.13.80.121
8 60 ms 61 ms 61 ms ae12.edge4.syd1.sp.lumen.tech [4.68.38.205]
9 151 ms 155 ms 171 ms ae15.15.bar1.Singapore4.level3.net [4.69.211.66]
10 238 ms 238 ms 238 ms ge9.1.br01.sin03.as3491.net [63.218.249.57]
11 243 ms 243 ms 243 ms BE41.clbr02.sin02.as3491.net [63.218.164.206]
12 * * * Request timed out.
13 * 251 ms * 63-217-21-70.static.as3491.net [63.217.21.70]
14 276 ms 282 ms 277 ms ae32.32.ear1.Dallas1.net.lumen.tech [4.69.210.141]
15 283 ms 283 ms 283 ms ZENIMAX-MED.edge9.Dallas1.Level3.net [4.31.132.194]
16 287 ms 287 ms 287 ms 198.20.200.1
So for NZ, we are now routed to Australia then Singapore before heading to Dallas USA. That is not efficient at all. What's going on ZOS?
Why are you punishing us like that?Edited by MrGarlic on February 11, 2025 5:14AM'Sharp Arrows'Mr.GarlicSpoilerHidden by darkness, a shadow in the night,A sped arrow dissecting the gloom,Finding it's target, such delight.3 -
LadyGP✭✭✭✭✭
✭Putting on trait research and horse training on PCEU, I get high ping 500-900ms. No point playing the game tonight.
PCNA Constant 300-400 ping here too.
Steaming pile of lag since last night's patch (10 Feb 2025)
Just did a TRACERT to the PCNA server.
6 59 ms 59 ms 59 ms et5-1-5.sebr3.global-gateway.net.nz [202.50.232.250]
7 59 ms 59 ms 61 ms 103.13.80.121
8 60 ms 61 ms 61 ms ae12.edge4.syd1.sp.lumen.tech [4.68.38.205]
9 151 ms 155 ms 171 ms ae15.15.bar1.Singapore4.level3.net [4.69.211.66]
10 238 ms 238 ms 238 ms ge9.1.br01.sin03.as3491.net [63.218.249.57]
11 243 ms 243 ms 243 ms BE41.clbr02.sin02.as3491.net [63.218.164.206]
12 * * * Request timed out.
13 * 251 ms * 63-217-21-70.static.as3491.net [63.217.21.70]
14 276 ms 282 ms 277 ms ae32.32.ear1.Dallas1.net.lumen.tech [4.69.210.141]
15 283 ms 283 ms 283 ms ZENIMAX-MED.edge9.Dallas1.Level3.net [4.31.132.194]
16 287 ms 287 ms 287 ms 198.20.200.1
So for NZ, we are now routed to Australia then Singapore before heading to Dallas USA. That is not efficient at all. What's going on ZOS?
Why are you punishing us like that?
I may be wrong in this statement (and if I am someone please correct me)... but isn't it your ISP that determines the best path to the datacenter and not ZoS?
It's odd you're having issues since the maintenance - a lot of people who have been having issues have made comments that their performance improved since then. No way to tell if their comments are isolated to like PC/NA or something though.LadyGP/xCatGuy
PC/NA0 -
Tandor✭✭✭✭✭
✭✭✭✭✭
I may be wrong in this statement (and if I am someone please correct me)... but isn't it your ISP that determines the best path to the datacenter and not ZoS?
It's odd you're having issues since the maintenance - a lot of people who have been having issues have made comments that their performance improved since then. No way to tell if their comments are isolated to like PC/NA or something though.
That's certainly my understanding, and my experience is also that by speaking to your ISP you can often get them to re-route your path.0 -
MrGarlic✭✭✭✭✭
✭
I may be wrong in this statement (and if I am someone please correct me)... but isn't it your ISP that determines the best path to the datacenter and not ZoS?
It's odd you're having issues since the maintenance - a lot of people who have been having issues have made comments that their performance improved since then. No way to tell if their comments are isolated to like PC/NA or something though.
That's a fair question, but the answer is, 'It depends. It's complicated.'
In the case of an anti -DDoS system, such as Akamai Prolexic system, it spoofs the IP of the intended target in order to 'attract' the route to it's servers, from there it will be send via Akamai backbone to the correct destination after it has analysed the data, adding overheads and latency.
So, if ESO is using any anti-DDoS system with a front-end in Singapore, then it will capture any IP requests in the geographic location to it's servers.
We had this happen in 2019 when ZOS started using Akamai and our Oceanic data was being routed through the nearest Akamai server, which was in Hong Kong. That was a huge detour to traffic and added 200ms to our ping to the USA. Eventually Akamai opened a server in Sydney Australia, which benefited Aussie, but added 20-30 ms to us Kiwis, compared to what we used to get.
I don't know specifically what ZOS is using for Anti-DDoS mitigation, but there is a history of what can happen when they do. Extra latency; in this case about `50% more is the result. Up from 250ms to 350ms.
I'd like to hear Zos interpretation, but they never discuss security issues publicly.'Sharp Arrows'Mr.GarlicSpoilerHidden by darkness, a shadow in the night,A sped arrow dissecting the gloom,Finding it's target, such delight.2 -
LadyGP✭✭✭✭✭
✭
That's a fair question, but the answer is, 'It depends. It's complicated.'
In the case of an anti -DDoS system, such as Akamai Prolexic system, it spoofs the IP of the intended target in order to 'attract' the route to it's servers, from there it will be send via Akamai backbone to the correct destination after it has analysed the data, adding overheads and latency.
So, if ESO is using any anti-DDoS system with a front-end in Singapore, then it will capture any IP requests in the geographic location to it's servers.
We had this happen in 2019 when ZOS started using Akamai and our Oceanic data was being routed through the nearest Akamai server, which was in Hong Kong. That was a huge detour to traffic and added 200ms to our ping to the USA. Eventually Akamai opened a server in Sydney Australia, which benefited Aussie, but added 20-30 ms to us Kiwis, compared to what we used to get.
I don't know specifically what ZOS is using for Anti-DDoS mitigation, but there is a history of what can happen when they do. Extra latency; in this case about `50% more is the result. Up from 250ms to 350ms.
I'd like to hear Zos interpretation, but they never discuss security issues publicly.
Of course. I'm mainly saying when DDoS mitigation efforts like Akami aren't enabled.LadyGP/xCatGuy
PC/NA1 -
randconfig✭✭✭YandereGirlfriend wrote: »The PTS server is randomly dead FWIW.
what do you mean?
I'm noticing occasional freezing of enemies in-game, and abilities not firing, but my ping appears to be fine.
PC NA starting around 5PM CST0 -
silky_soft✭✭✭✭✭
✭Putting on trait research and horse training on PCEU, I get high ping 500-900ms. No point playing the game tonight.
PCNA Constant 300-400 ping here too.
Steaming pile of lag since last night's patch (10 Feb 2025)
Just did a TRACERT to the PCNA server.
6 59 ms 59 ms 59 ms et5-1-5.sebr3.global-gateway.net.nz [202.50.232.250]
7 59 ms 59 ms 61 ms 103.13.80.121
8 60 ms 61 ms 61 ms ae12.edge4.syd1.sp.lumen.tech [4.68.38.205]
9 151 ms 155 ms 171 ms ae15.15.bar1.Singapore4.level3.net [4.69.211.66]
10 238 ms 238 ms 238 ms ge9.1.br01.sin03.as3491.net [63.218.249.57]
11 243 ms 243 ms 243 ms BE41.clbr02.sin02.as3491.net [63.218.164.206]
12 * * * Request timed out.
13 * 251 ms * 63-217-21-70.static.as3491.net [63.217.21.70]
14 276 ms 282 ms 277 ms ae32.32.ear1.Dallas1.net.lumen.tech [4.69.210.141]
15 283 ms 283 ms 283 ms ZENIMAX-MED.edge9.Dallas1.Level3.net [4.31.132.194]
16 287 ms 287 ms 287 ms 198.20.200.1
So for NZ, we are now routed to Australia then Singapore before heading to Dallas USA. That is not efficient at all. What's going on ZOS?
Why are you punishing us like that?
I've got a crazy amount of hops now from Australia
6 97 ms 91 ms 92 ms 8.244.64.245
7 91 ms 91 ms 90 ms ge9.1.br01.sin03.as3491.net [63.218.249.57]
8 91 ms 95 ms 92 ms Bundle-Ether42.clbr02.sin02.as3491.net [63.223.34.58]
9 206 ms 205 ms * Bundle-Ether42.br05.lax05.as3491.net [63.223.43.126]
10 205 ms 206 ms 205 ms dhcp117.accelix.com [63.220.195.117]
11 235 ms 236 ms * ae32.32.ear1.Dallas1.net.lumen.tech [4.69.210.141]
12 240 ms 235 ms 236 ms ZENIMAX-MED.ear1.Dallas1.Level3.net [4.71.220.18]
13 236 ms 236 ms 236 ms 198.20.200.1
Previously when I have had Lumen in the tracert it's been about 7 or 8 hops.I have no will left to help with lag until high action per minute devs play via a vpn from Asia or Oceania to NA and live stream thier experience of thier actions being declined by the server because they are out of frame.0 -
blktauna✭✭✭✭✭
✭✭Akamai is the killer. The more jumps the worse the lag is.
Today PC EU was ok 4pm EST to 6pm EST but NA was jerky and had skill loss at 7:30pm to 8 pmPCNA
PCEU1 -
Sootica✭Since this most recent maintenance, ping has gone up about 50-100, with frequent spikes. My usual ping is 220-250 (Australia), now it is consistently 280s, going into 300-500 for many minutes at a go. I have tried 3 different computers, updated and restarted router, not working.
What was changed during this most recent maintenance? Will this be fixed?
Edit to tag @silky_soft @MrGarlic who seem to have similar issues, exactly since this most recent maintenance Feb 10th. All 3 of us seem to play from Aus/NZ.Edited by Sootica on February 12, 2025 11:52AM3
