MAJOR LATENCY PROBLEMS ON ALL NA PLATFORMS for last 3 days and no single reply from ZOS yet!

Thogard · July 2017

Diminish wrote: »

Thogard wrote: »

...
It is a node NEXT to the ZOS servers, but it is NOT the ZOS servers.

ZoS servers or not, ZoS is paying someone to colocate their servers, and therefore it is still their problem. They should be very transparent at times like this, especially if it is not directly their issue. Instead they are being very silent on the matter while mass amounts of players are being effected. This is not how a company should treat those who feed their profits.If this was the ISP I work for, and we did this to our customers when one of our backbones have problems we would not be in business.

Also, what professional company that relies on network connectivity for their services uses a single backbone, and no redundancy. This *** is amateur hour that I'd expect to see from Joe Blows Internet Service operating out of an apartment in a town with a population of 500, not some corporate powerhouse. Their is no excuse for this which is probably why it is taking them so long to publicly announce one outside of there generic twitter post.

You have an incorrect understanding of how the internet works. I suggest you run a tracert to the ZOS server, which is 198.20.198.110

Here is mine with my VPN turned off, so i'm using the default pathing assigned to me by my ISP, which you can clearly see is charter.

C:\>tracert 198.20.198.110

Tracing route to 198.20.198.110 over a maximum of 30 hops

1 2 ms 2 ms 2 ms RT-N66R-CC18 [192.168.1.1]
2 * * * Request timed out.
3 13 ms 14 ms 17 ms acr01nrwlca-gbe-1-10.nrwl.ca.charter.com
4 19 ms 14 ms 13 ms crr01mtpkca-tge-0-6-0-8.mtpk.ca.charter.com
5 15 ms 14 ms 22 ms bbr01stcdmn-tge-0-1-0-3.stcd.mn.charter.com [96.34.2.212]
6 14 ms 14 ms 16 ms be4016.ccr41.lax05.atlas.cogentco.com [38.104.84.101]
7 17 ms 14 ms 15 ms be3033.ccr22.lax01.atlas.cogentco.com [154.54.26.41]
8 29 ms 31 ms 25 ms be2932.ccr22.phx02.atlas.cogentco.com [154.54.45.161]
9 38 ms 38 ms 39 ms be2930.ccr21.elp01.atlas.cogentco.com [154.54.42.78]
10 49 ms 52 ms 50 ms be2927.ccr41.iah01.atlas.cogentco.com [154.54.29.221]
11 54 ms 60 ms 59 ms be2441.ccr31.dfw01.atlas.cogentco.com [154.54.41.66]
12 56 ms 55 ms 59 ms be2763.ccr41.dfw03.atlas.cogentco.com [154.54.28.74]
13 58 ms 58 ms 57 ms 192.205.36.221
14 59 ms 63 ms 62 ms cr2.dlstx.ip.att.net [12.123.16.78]
15 95 ms 95 ms 161 ms gar24.dlstx.ip.att.net [12.122.100.77]
16 * * * Request timed out.
17 * * * Request timed out.
etc...

So you can see two things pretty clearly. FIrst, you can see that even though I have Charter, my connection is still passing through two different ATT nodes in the Dallas Texas area. Second, the ATT node at 12.122.100.77 has a significantly higher ping than the rest. Ive run a few tracerts on it and have been getting a lot of variance out of that node. Sometimes its low (61) and sometimes its high. The variance is what makes me suspicious.

So i use a VPN to bypass that node and connect directly from US Host 2 in dallas. Bypassing the ATT node still connects me to the same ZOS server, but it eliminates the lag spikes.

If you are having trouble with lag, do a tracert on the server IP and see if you're going through ATT at any point. If you are, you need to bypass that ATT node by using a VPN. If your lag is more constant, but bearable, then odds are your problem is something else.

When I use my VPN and bypass the ATT node, my ping becomes constant..

(my ping from yesterday using a VPN to bypass ATT node)

Unfadingsilence · July 2017

Piraja27 wrote: »

Unfadingsilence wrote: »

Piraja27 wrote: »

Unfadingsilence wrote: »

Piraja27 wrote: »

mandricus wrote: »

As someone pointed out in this thread ( https://forums.elderscrollsonline.com/en/discussion/357557/really-were-gonna-get-the-silent-treatment), it is probably a routing issue happening at backbones level, on a NA regional basis. Probably Zos has nothing to do with it, nor they can do anything in order to fix the problem. It is happening on the customer's network side. You can't really blame them if your ISP has some routing issues. As for me, I can report that on Pc-Eu everything is working smoothly and with no issues at all. No one is complaining. P. S. Please note someone in that thread reported that is playing on PC Na from South Africa, without having any issues.

Finland 11mbs download speed, 6.7mbs upload speed. Overwatch, Halo 5 etc works as usual 30 ping or so. Common ping for me for NA servers is 150 or so, currently 500-999+ my friend from same country has same issue, my friend from the States has same issue, yeah no it is not just our ISP.
(ESO being played on PC)

OMG I can't imagine ever playing with that slow of a connection anymore I did once a long time ago and the game was unplayable ESO runs great with Google fiber 1000mbps upload and 1000mbps download

The game requires under 1mbs to run consistently. So mine is more than enough to run the game.

Ya I get that but I have played with that kinda speed before and it's so unplayable like you can log on and do some crafting and maybe farm some mats but when it comes to high end PVE content and big 50+ 100+ pvp last emp keep fights it's GG with speeds like that I know with Google fiber I see almost zero lag even with 100+ ppl fighting at a keep but as of late over the last few days I only log in to do my crafting and that's it cuz I'm out of town and missing my Google fiber I'm running around 5 maybe 10mbps upload and 5 download speed and I crash if I go into pvp to get into a big city with a lot of people in it

Starting to wonder what kind of rig you run if the game crashes for due internet speed on those numbers... for me other than the past 9 days, game has ran just fine with my internet speed even when there is a lot of people on my screen.

Well as of right now since I'm out of town and the Internet really is trash right now I can't play at all but when I'm on my at home set up I see zero to little lag even when so many people where going on and on about the lag and crashing with vmaw I seen nothing at all I was in groups where half the group would crash and they would blame it on zos but yet with running 1G speeds I was seeing nothing wrong with the game here's an older clips of last time I was out of town and using this crap Internet speed the first clip shows how much lag there was with very few ppl around and the second clip still a little lag bug more ppl where around and the Internet quality was better
http://xboxdvr.com/gamer/UnfadingSilence/video/31707244

Argah · July 2017

XB1 has been no worse than any time the last 2 years.

Diminish · July 2017

Thogard wrote: »

Diminish wrote: »

Thogard wrote: »

...
It is a node NEXT to the ZOS servers, but it is NOT the ZOS servers.

ZoS servers or not, ZoS is paying someone to colocate their servers, and therefore it is still their problem. They should be very transparent at times like this, especially if it is not directly their issue. Instead they are being very silent on the matter while mass amounts of players are being effected. This is not how a company should treat those who feed their profits.If this was the ISP I work for, and we did this to our customers when one of our backbones have problems we would not be in business.

Also, what professional company that relies on network connectivity for their services uses a single backbone, and no redundancy. This *** is amateur hour that I'd expect to see from Joe Blows Internet Service operating out of an apartment in a town with a population of 500, not some corporate powerhouse. Their is no excuse for this which is probably why it is taking them so long to publicly announce one outside of there generic twitter post.

You have an incorrect understanding of how the internet works. I suggest you run a tracert to the ZOS server, which is 198.20.198.110

Here is mine with my VPN turned off, so i'm using the default pathing assigned to me by my ISP, which you can clearly see is charter.

C:\>tracert 198.20.198.110

Tracing route to 198.20.198.110 over a maximum of 30 hops

1 2 ms 2 ms 2 ms RT-N66R-CC18 [192.168.1.1]
2 * * * Request timed out.
3 13 ms 14 ms 17 ms acr01nrwlca-gbe-1-10.nrwl.ca.charter.com
4 19 ms 14 ms 13 ms crr01mtpkca-tge-0-6-0-8.mtpk.ca.charter.com
5 15 ms 14 ms 22 ms bbr01stcdmn-tge-0-1-0-3.stcd.mn.charter.com [96.34.2.212]
6 14 ms 14 ms 16 ms be4016.ccr41.lax05.atlas.cogentco.com [38.104.84.101]
7 17 ms 14 ms 15 ms be3033.ccr22.lax01.atlas.cogentco.com [154.54.26.41]
8 29 ms 31 ms 25 ms be2932.ccr22.phx02.atlas.cogentco.com [154.54.45.161]
9 38 ms 38 ms 39 ms be2930.ccr21.elp01.atlas.cogentco.com [154.54.42.78]
10 49 ms 52 ms 50 ms be2927.ccr41.iah01.atlas.cogentco.com [154.54.29.221]
11 54 ms 60 ms 59 ms be2441.ccr31.dfw01.atlas.cogentco.com [154.54.41.66]
12 56 ms 55 ms 59 ms be2763.ccr41.dfw03.atlas.cogentco.com [154.54.28.74]
13 58 ms 58 ms 57 ms 192.205.36.221
14 59 ms 63 ms 62 ms cr2.dlstx.ip.att.net [12.123.16.78]
15 95 ms 95 ms 161 ms gar24.dlstx.ip.att.net [12.122.100.77]
16 * * * Request timed out.
17 * * * Request timed out.
etc...

So you can see two things pretty clearly. FIrst, you can see that even though I have Charter, my connection is still passing through two different ATT nodes in the Dallas Texas area. Second, the ATT node at 12.122.100.77 has a significantly higher ping than the rest. Ive run a few tracerts on it and have been getting a lot of variance out of that node. Sometimes its low (61) and sometimes its high. The variance is what makes me suspicious.

So i use a VPN to bypass that node and connect directly from US Host 2 in dallas. Bypassing the ATT node still connects me to the same ZOS server, but it eliminates the lag spikes.

If you are having trouble with lag, do a tracert on the server IP and see if you're going through ATT at any point. If you are, you need to bypass that ATT node by using a VPN. If your lag is more constant, but bearable, then odds are your problem is something else.

When I use my VPN and bypass the ATT node, my ping becomes constant..

(my ping from yesterday using a VPN to bypass ATT node)

My 18 years of professional experience as a network engineer begs to differ. I am well aware of how the Internet works. With that said, it is not uncommon for devices on AT&T's network to experience 100 - 150ms latency; I see it all the time since our backbones are fiber connections from both AT&T, and Charter in our office. I assure you that the problems with ESO are not stemming from 150ms latency to a single hop. I have contacts at AT&T, both due to my profession and family. I know the turn around time for them to fix network issues, and it is hours... Not days

I (and I am sure many others) do not even hit that device in my route. I still lag and rubberband like crazy.

SHivalrey · July 2017

Category: Norton Community Watch
Date & Time,Risk,Activity,Status,Recommended Action,Date Updated,Submitted By,Description,Submission Details
7/6/2017 9:58:36 PM,Info,IPS Detection Statistical Submission,Submitted,No Action Required,7/6/2017 9:58:36 PM,Norton Security,IPS Detection Statistical Submission,"Signature ID: 23318 Local or Remote Attacker: 2 Application Name: \DEVICE\HARDDISKVOLUME4\PROGRAM FILES (X86)\ZENIMAX ONLINE\LAUNCHER\BETHESDA.NET_LAUNCHER.EXE [Offending URL: launcher.bethesda.net/ESO/depot.patchmanifest [] Date Detected: Fri, 07d Jul 2017d 01d:58d:36d GMT Application File Checksum: C4147EA7ABCFD46AC996B9D1152D8788 Application File Information: 3.6.10.0

This triggers ever five minutes when logged in. I hope this helps this has become unplayable I have been dropped over 12 times today, ping rates over 12K

Wycks · July 2017

Sibenice · July 2017

Wycks wrote: »

So quickly people forget how many issues blizzard servers have and have had. Yeah, they're more stable than they used to be but I have soooooo many horror stories from playing WoW. Servers being down for 72+ hours at a time, tons of random crashes, that year they were constantly being DDOSed during prime raiding time, the fiasco that was WoD launch and the 9-12 hour queue times with massive lag if you actually managed to make it all the way through the queue without just crashing there.

Everything's greener until you actually go there.

Thogard · July 2017

SHivalrey wrote: »

Category: Norton Community Watch
Date & Time,Risk,Activity,Status,Recommended Action,Date Updated,Submitted By,Description,Submission Details
7/6/2017 9:58:36 PM,Info,IPS Detection Statistical Submission,Submitted,No Action Required,7/6/2017 9:58:36 PM,Norton Security,IPS Detection Statistical Submission,"Signature ID: 23318 Local or Remote Attacker: 2 Application Name: \DEVICE\HARDDISKVOLUME4\PROGRAM FILES (X86)\ZENIMAX ONLINE\LAUNCHER\BETHESDA.NET_LAUNCHER.EXE [Offending URL: launcher.bethesda.net/ESO/depot.patchmanifest [] Date Detected: Fri, 07d Jul 2017d 01d:58d:36d GMT Application File Checksum: C4147EA7ABCFD46AC996B9D1152D8788 Application File Information: 3.6.10.0

This triggers ever five minutes when logged in. I hope this helps this has become unplayable I have been dropped over 12 times today, ping rates over 12K

I posted a temporary fix if you're on PC NA.

https://forums.elderscrollsonline.com/en/discussion/357643/guide-how-to-fix-the-current-lag-spike-issue-using-a-vpn/p1

Strongly recommend you check it out

ChunkyCat · July 2017

I haven't had any lag problems.

At all.

Wycks · July 2017

Sibenice wrote: »

Wycks wrote: »

So quickly people forget how many issues blizzard servers have and have had. Yeah, they're more stable than they used to be but I have soooooo many horror stories from playing WoW. Servers being down for 72+ hours at a time, tons of random crashes, that year they were constantly being DDOSed during prime raiding time, the fiasco that was WoD launch and the 9-12 hour queue times with massive lag if you actually managed to make it all the way through the queue without just crashing there.

Everything's greener until you actually go there.

ESO has been out for 3 years now. I know ZOS doesn't have nearly the budget (or talent) that Blizzard has, but not saying anything for 3-4 + days is also not really acceptable either. The technology and industry has changed a lot since WOW release, they had to deal with a very different reality, so a real comparison needs to take that into account.

That's an actual picture from one of several Blizzard dev ops rooms , it was a joke obviously ,but maybe ZOS can be forthcoming and post a photo of their dev ops rooms, or is it all out sourced...?

Elsonso · July 2017

Wycks wrote: »

ESO has been out for 3 years now. I know ZOS doesn't have nearly the budget (or talent) that Blizzard has, but not saying anything for 3-4 + days is also not really acceptable either. The technology and industry has changed a lot since WOW release, they had to deal with a very different reality, so a real comparison needs to take that into account.

That's an actual picture from one of several Blizzard dev ops rooms , it was a joke obviously ,but maybe ZOS can be forthcoming and post a photo of their dev ops rooms, or is it all out sourced...?

We already know that the monitoring that ZOS does is more like the bottom picture than the top one. The picture for Blizzard is a little over the top, by the way. All of the monitoring necessary for the megaserver can be condensed to a single computer with one person sitting in front of it. Not as impressive looking, to be sure, but just as effective.

They have posted a couple times in the forums over the last couple of days with updates and resolution information.

Besides, if you have been paying attention, you would know that the recent NA lag problem (over the last week) was not caused by the ZOS servers or ISP, nor was it a problem with the player's ISPs. It was a company providing part of the route between the players and the game.

All things considered, once ZOS became aware of the problem, and with the assistance of a few players who dug into this and provided information to ZOS, they did a good job of getting to that company and making them aware of the issue so that they could fix it.

Nestor · July 2017

Diminish wrote: »

it is not uncommon for devices on AT&T's network to experience 100 - 150ms latency;

If that was what the Latencies were, then we would not be having all this drama. However, when I see ping's or 999+ in my game, I am seeing the same thing with Pings to ZOS servers.

Drachenfier · July 2017

Nestor wrote: »

Diminish wrote: »

it is not uncommon for devices on AT&T's network to experience 100 - 150ms latency;

If that was what the Latencies were, then we would not be having all this drama. However, when I see ping's or 999+ in my game, I am seeing the same thing with Pings to ZOS servers.

Those are the latencies that traceroute showed, posted above, which is what he was referring to. I agree with Diminish, I don't think all of this stems from one AT&T node.

Sibenice · July 2017

Wycks wrote: »

Sibenice wrote: »

Wycks wrote: »

So quickly people forget how many issues blizzard servers have and have had. Yeah, they're more stable than they used to be but I have soooooo many horror stories from playing WoW. Servers being down for 72+ hours at a time, tons of random crashes, that year they were constantly being DDOSed during prime raiding time, the fiasco that was WoD launch and the 9-12 hour queue times with massive lag if you actually managed to make it all the way through the queue without just crashing there.

Everything's greener until you actually go there.

ESO has been out for 3 years now. I know ZOS doesn't have nearly the budget (or talent) that Blizzard has, but not saying anything for 3-4 + days is also not really acceptable either. The technology and industry has changed a lot since WOW release, they had to deal with a very different reality, so a real comparison needs to take that into account.

That's an actual picture from one of several Blizzard dev ops rooms , it was a joke obviously ,but maybe ZOS can be forthcoming and post a photo of their dev ops rooms, or is it all out sourced...?

Yes, a lot has changed since WoW release but not everything listed was from back then. The WoD release was one expansion ago and the DDOS year was the year after the release. The 3+ days of servers being down was further in the past but I remember it happening when WoW was at least twice as old as ESO. Blizzard does a good job but they have server issues. Everyone does. With all I've experienced through WoW as well as a multitude of other MMOs and other big online games ESO's stuff actually is not that bad. Definitely not the best. But They do pretty well.