The Elder Scrolls Online

Sandmanninja · July 2022

For the past 2-3 days, I've experienced a big jump in lag in the game. I don't mean in PVP (I don't PVP), but in everything - casting spells, riding my horse, my companion being left waaaay behind me then he rockets past me, talking to vendors - just the usual lag activities. I've asked in zone chat (in many different zones) and there's always a few people that say they have the same lag as well.

Has anyone here experienced anything similar?

ZOS_Hadeostry · July 2022

Greetings,

After further review we have decided to move this thread to a category we think is more appropriate for this topic.

Thank you for your understanding.

KaosWarMonk · July 2022

Yes, since Sunday.

In the afternoon local time (around mid/late evening US time) I start to get packet loss. Seems to get worse as the day goes on sitting at about 10-20% by the time the daily quests reset. When I come back the next day it's down to zero packet loss. Has happened for the past 3 days now.

As per the connection support page I'm pinging 198.20.200.1 for PC/NA. Doing the same for PC/EU gives me 0% packet loss, no matter what time. Doing pathping gives me variations of this:

 12  148ms     0/ 100 =  0%     0/ 100 =  0%  i-10604.1wlt-core02.telstraglobal.net [202.84.141.225] 
                                0/ 100 =  0%   |
 13  148ms     0/ 100 =  0%     0/ 100 =  0%  i-10604.1wlt-core02.telstraglobal.net [202.84.141.225] 
                                0/ 100 =  0%   |
 14  186ms     0/ 100 =  0%     0/ 100 =  0%  i-93.tlot02.bi.telstraglobal.net [202.84.253.86] 
                               11/ 100 = 11%   |
 15  243ms    13/ 100 = 13%     2/ 100 =  2%  xe-11-2-0.edge1.losangeles6.level3.net [4.68.62.9] 
                                0/ 100 =  0%   |
 16  328ms    18/ 100 = 18%     7/ 100 =  7%  4.69.210.137 
                                0/ 100 =  0%   |
 17  ---     100/ 100 =100%    89/ 100 = 89%  ZENIMAX-MED.ear1.Dallas1.Level3.net [4.71.220.18] 
                                0/ 100 =  0%   |
 18  278ms    11/ 100 = 11%     0/ 100 =  0%  198.20.200.1

I've logged a ticket but got a standard copy/paste response.

blktauna · July 2022

Good, its not just me. I'm getting a load of stutter lag in dungeons and trials.

Cuddlypuff · July 2022

Lately I have been monitoring traffic/bandwidth for this game to troubleshoot severe lag in Cyrodiil. One surprising result is that the game uses up to 5MB / second during some fights and was saturating my VPN connection. For comparison, I've never seen it hit over 1MB/s even during the most chaotic 3 faction stack primetime fights in the past.

AramDol · July 2022

Yep, just over 3 days ago now.
I was playing when it started. My ping is usually 231ms. At about 2022-07-03T05:00z it started bouncing around, from +999 to 340ms, except when it says it's 340ms, there's tremendous amounts of packet loss. At least that's what it looks like, my network link works flawlessly for everything except ESO. All the diagnostics show that there is no network interruption between ESO's server and me. Infact I was helping a new player at the time, and we were streaming each others screens on Discord when it started happening, so I could see that it was working perfectly on his machine, and he could see that while the video was working perfectly, the server was most certainly not. All day it was playing as good as usual, and then bang, for the rest of the day it would take 10+ seconds for me to mount my horse.

I can do things like scrying, and only just do writs. Sometimes it will let me do dungeons as a tank. If I go near big combat combat (for example harrowstorms for the event) it just disconnects me. Here's a video of it in action, with no addons installed.

https://www.youtube.com/watch?v=mKBJfIQXI8M

And here's a slightly older video showing my usual ping.

https://www.youtube.com/watch?v=akDg-Wf0jdY

Of the 20 or so people playing this game I keep in regular contact with, it has affected 2 others. There is no pattern as to where they are geologically.

The problem is not on our end.

AramDol · July 2022

Seems pretty clear to me that one or more nodes in the load balancing setup is malfunctioning.

What really gets me though, is that in such a setup, surely after 7 years someone would have set up some sort of monitoring.
There's a node that is...
* Using much more network given its number of users
* Using much less network given its number of users
* Seeing packet loss outside of a given threshold
* Using more or less CPU or RAM

Seems like the kind of thing that would automatically be sending emails to a mailing list with at least a few dozen technically inclined people on it. I mean unless that list is just spammed so hard with notifications that everyone filters that list out, but that's a whole other problem.

KaosWarMonk · July 2022

It's starting again today - currently getting 5% packet loss to 198.20.200.1

When I connected this morning (around 6 hours ago) it was running completely fine. This is the same pattern for the past 4 days.

11   12ms     0/ 100 =  0%     0/ 100 =  0%  i-10401.sydo-core04.telstraglobal.net [202.84.222.138] 
                                0/ 100 =  0%   |
 12  149ms     0/ 100 =  0%     0/ 100 =  0%  i-10604.1wlt-core02.telstraglobal.net [202.84.141.225] 
                                0/ 100 =  0%   |
 13  148ms     0/ 100 =  0%     0/ 100 =  0%  i-10604.1wlt-core02.telstraglobal.net [202.84.141.225] 
                                0/ 100 =  0%   |
 14  186ms     0/ 100 =  0%     0/ 100 =  0%  i-93.tlot02.bi.telstraglobal.net [202.84.253.86] 
                                5/ 100 =  5%   |
 15  214ms     5/ 100 =  5%     0/ 100 =  0%  xe-11-2-0.edge1.losangeles6.level3.net [4.68.62.9]

Sandmanninja · July 2022

Great news that others are getting the same experience. I'm glad it's not just me.
Bad news that it's not just me - that would mean I could theoretically fix it on my end.

@ZOS_Hadeostry any chance you could look at this thread and point it to the right people? You moved this discussion to what I'd consider to be the proper category, but I suggest that there should be some follow-through after doing so. Things like flagging the moved the discussion to re-visit and then pass it on to the tech support team internal.
There has been some magnificent troubleshooting captured here - video captures with no add-ons as well as pings to your infrastructure.

@ZOS_GinaBruno Can you perhaps to do the same?

AramDol · July 2022

Finished downloading the PTS release, problem is on there too.
EU server works fine.

It's worth noting, that pointing a browser at level3.net takes an alarming time to be redirected to lumen.net
I'm using the cloudflare DNS.

Sandmanninja · July 2022

My latency times ingame show 350ms, which is how long the final hop takes.

Tracing route to 198.20.200.1 over a maximum of 30 hops

4 7 ms 5 ms 4 ms bundle-ether25.cha-core10.brisbane.telstra.net [203.50.61.0]
5 20 ms 20 ms 19 ms bundle-ether20.ken-core10.sydney.telstra.net [203.50.11.178]
6 18 ms 19 ms 20 ms bundle-ether1.pad-gw11.sydney.telstra.net [203.50.6.61]
7 20 ms 21 ms 18 ms 203.50.13.90
8 154 ms 154 ms 157 ms 203.50.13.90
9 157 ms 156 ms 154 ms i-20802.eqnx-core02.telstraglobal.net [202.84.141.25]
10 219 ms 248 ms * i-14808.ny8a-core01.telstraglobal.net [202.40.148.98]
11 246 ms 217 ms 216 ms i-0-0-2-0.ny8a02.bi.telstraglobal.net [202.40.148.174]
12 * * * Request timed out.
13 * * * Request timed out.
14 351 ms * 352 ms ZENIMAX-MED.ear1.Dallas1.Level3.net [4.71.220.10]
15 * 350 ms * 198.20.200.1
16 352 ms 352 ms 352 ms 198.20.200.1

deleted221205-002626 · July 2022

Cuddlypuff wrote: »

Lately I have been monitoring traffic/bandwidth for this game to troubleshoot severe lag in Cyrodiil. One surprising result is that the game uses up to 5MB / second during some fights and was saturating my VPN connection. For comparison, I've never seen it hit over 1MB/s even during the most chaotic 3 faction stack primetime fights in the past.

Ive been saying this for years since like 2014 and has been a major cause of lag for many. Its ALOT of data during HUGE fights wether it be pvp or pve! But we have amazing effects, combat cues and positional sync that many other games lack which is likely the brunt of it. Do we want to reduce the data and play something like minecraft?

KaosWarMonk · July 2022

Looks like this one might have been resolved.

I'm not getting any dropped packets at xe-11-2-0.edge1.losangeles6.level3.net [4.68.62.9] today

And a bonus... My ping times have impreoved slightly

sentientomega · July 2022

I've been getting lag on EU just now, delve fights are super laggy, a speed test showed nothing out of the ordinary.

EDIT: NA's doing the same right now.

AramDol · July 2022

Seems the issue has been alleviated with the update. It disturbs me that restarting the servers was how this was negated, rather than finding the underlying issue. I say that it is a matter of time before other individuals come forwards with the exact same issue.

On to the other matter at hand. 5 days of ZOS being unable to deliver the service we are paying for. What are they going to do about it?

AramDol · July 2022

Welp, the packet loss is back, not as bad as before, but I'm sure that's just me catching it early.

17  210ms     0/ 100 =  0%     0/ 100 =  0%  i-93.tlot02.bi.telstraglobal.net [202.84.253.86]
                                3/ 100 =  3%   |
 18  270ms     3/ 100 =  3%     0/ 100 =  0%  xe-11-2-0.edge1.losangeles6.level3.net [4.68.62.9]
                                0/ 100 =  0%   |
 19  283ms     3/ 100 =  3%     0/ 100 =  0%  4.69.210.141
                                1/ 100 =  1%   |
 20  ---     100/ 100 =100%    96/ 100 = 96%  ZENIMAX-MED.edge9.Dallas1.Level3.net [4.31.132.194]
                                0/ 100 =  0%   |
 21  272ms     4/ 100 =  4%     0/ 100 =  0%  198.20.200.1

Just like before, this makes the game unplayable. I don't mean it makes it hard or difficult to play, I mean it makes it impossible to play. I consider this down time. How long until ESO reaches 0 nines?

@ZOS_GinaBruno @ZOS_Hadeostry has anyone even acknowledged this?

AramDol · July 2022

It's very difficult to play when you get death logs like this...

mavfin · July 2022

Yes, you really really need to address the lag spikes. I don't care a whit about Update 35's changes, but if the lag spikes don't stop, I'll be finding a new game.

I've played this game for years with no lag, so it's extremely annoying to have to fight 1s+ ping for part of every hour, it feels like.

Fix it.

miguelcura · July 2022

mavfin wrote: »

Yes, you really really need to address the lag spikes. I don't care a whit about Update 35's changes, but if the lag spikes don't stop, I'll be finding a new game.

I've played this game for years with no lag, so it's extremely annoying to have to fight 1s+ ping for part of every hour, it feels like.

Fix it.

idem

miguelcura · July 2022

Are you sure that the IP of the server is 198.200.20.1 ? It's weird, ingame it always shows me 220 with peaks of 300ms but when I do a winmtr I don't even reach 180ms (which is the same thing I have in WoW, game with which I don't have any problem or delay)
Now this strengthens my theory that the issue is not latency but failing server processing. There are times when it is unplayable, and it is the only online game of the ten that I play that has this problem.

|

|

|
| 192.168.1.1 - 0 | 204 | 204 | 0 | 1 | 9 | 1 |
| No response from host - 100 | 41 | 0 | 0 | 0 | 0 | 0 |
| No response from host - 100 | 41 | 0 | 0 | 0 | 0 | 0 |
| No response from host - 100 | 41 | 0 | 0 | 0 | 0 | 0 |
| No response from host - 100 | 41 | 0 | 0 | 0 | 0 | 0 |
| host168.181-96-103.telecom.net.ar - 98 | 42 | 1 | 0 | 17 | 17 | 17 |
| ae13.baires3.bai.seabone.net - 0 | 204 | 204 | 8 | 13 | 38 | 13 |
| ae0.miami16.mia.seabone.net - 0 | 204 | 204 | 131 | 135 | 156 | 133 |
| ae-15.edge6.Miami1.Level3.net - 1 | 201 | 200 | 162 | 171 | 213 | 169 |
| 4.69.210.137 - 75 | 51 | 13 | 158 | 161 | 167 | 159 |
| No response from host - 100 | 41 | 0 | 0 | 0 | 0 | 0 |
| 198.20.200.1 - 0 | 204 | 204 | 159 | 164 | 180 | 161 |
|________________________________________________|______|______|______|______|______|______|
WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

Lag