(really) Server is up PC NA

Alinhbo_Tyaka

Zuboko wrote: »

Alinhbo_Tyaka wrote: »

Zuboko wrote: »

7 pm now.
https://forums.elderscrollsonline.com/en/discussion/606867/

I get the feeling no thought is being put into the time estimates. The way they are always two hours makes me think someone asks how much longer and the response is a couple of more hours. I'd rather they say they are still trying to determine the problem with no estimate for now or we will provide updates as tot eh status on the hour even if it nothing more than no change.

No, can almost guarantee they are putting thought into it. The problem with providing accurate time estimates can be found in understanding the difficulty of troubleshooting complex systems.
https://www.youtube.com/watch?v=dPFw2ckWZyY

I had over 30 years of architecture and design in mainframe operating systems and communications stacks. I am well aware of complex problem determination and went through it often through my career. We are not talking about an estimate that was given of let's say 1 PM and at 1 o'clock they say it will take another 20 - 30 minutes. We are talking of missing the target 4 times for a period of 8 hours which tells me they are throwing out numbers to keep people off their backs. ZOS would be much better off updating us where they are in problem diagnosis stages rather than throwing out times. Once they know what the problem is and how they will resolve it they should be able to calculate a somewhat reliable up time estimate that they can actually make.

Iselin

Lady_Titania wrote: »

Are we going to receive compensation for this 12 hour delay on NA PC?

Probably. You get an XP scroll and you get an XP scroll... everybody gets an XP scroll!

OhDraw

LonePirate wrote: »

These repeated extensions tell me they have no idea how much longer it will be, provided they even know what’s wrong.

Given that PC-NA just had a hardware upgrade, and PC-EU did not, I suspect this is one of those really miserable hardware+software+data issues where database shards are de-synchronizing for no apparent reason.

Troubleshooting these is a nightmare, especially when everything's working fine on OTHER systems (PTS and EU.)

(I did tech support for corporate software back in the pre-cloud days, back when these things were 1/100th the size. SO MISERABLE.)

Crismac

Zuboko wrote: »

Crismac wrote: »

What if the next update says...

Sorry folks a complete server wipe is needed.

The title- High Isle the new beginning.

I had an MMO that I play do this very thing.

ESO prob never will do this, but since I have seen it happen. You never know.

I would keep playing.

I agree, I did the same in that game. Most weren't happy about it, but it is going on for 13 years now.

BergisMacBride

Not sure when ZOS has to cross the rubicon to restore from a backup, but the longer this goes on seems to increase its chances.

I certainly would like a post-mortem from Matt on what went wrong today and caused the back-end implosion. I know they’re doing everything they can to get it corrected, but days like today only serve to decrease our confidence in them further. I always have low expectations on patch days, usually just wanting to get the addons squared away and do daily writs. If this keeps up, even those won’t be possible.

Tornaad

OhDraw wrote: »

LonePirate wrote: »

These repeated extensions tell me they have no idea how much longer it will be, provided they even know what’s wrong.

Given that PC-NA just had a hardware upgrade, and PC-EU did not, I suspect this is one of those really miserable hardware+software+data issues where database shards are de-synchronizing for no apparent reason.

Troubleshooting these is a nightmare, especially when everything's working fine on OTHER systems (PTS and EU.)

(I did tech support for corporate software back in the pre-cloud days, back when these things were 1/100th the size. SO MISERABLE.)

I didn't have the technical experience to name something specific, but I was thinking it was something like this.

Zuboko wrote: »

SkaraMinoc wrote: »

Blackwood was such a smooth launch. On time and great performance on Day 1.

I wonder what happened with High Isle.

They changed the hardware in the data center. The only server that is having problems is the one connected to the data center hardware they replaced. So, most likely something small was missed in the replacement that just got discovered with the update. See my earlier linked video giving an insight into complex systems.

kindred

meep meep

Poncho28

barney2525

Heading for 7pm EST.

Can I hear 9pm ?

Anyone? Anyone ?

ibrac_ESO

LonePirate wrote: »

These repeated extensions tell me they have no idea how much longer it will be, provided they even know what’s wrong.

They said it's a Database Issue.

With a new release, there are massive updates to the production database for all the new items, quests, zones, NPC's etc that have to be added as well as all the fields for each player to track their interactions with them.

If something went wrong with the database upgrade, they could be rolling it back, maybe restoring it from pre upgrade, figuring out what happened, changing and testing the code and then trying to upgrade the database again. Each step could take over an hour, if it goes well. I'm surprised they thought they could fix it fast and keep sending out these two hour updates. I wouldn't be surprised if the Dev's were saying "Order more caffeine, its going to be a long night!"

Once I heard "Database" I figured we'd be lucky to play today.

Tornaad

barney2525 wrote: »

Heading for 7pm EST.

Can I hear 9pm ?

Anyone? Anyone ?

Zuboko wrote: »

karthrag_inak wrote: »

Ah, Khajiit has 7pm...how about 9 pm? Does khajiit hear 9 pm? Come one, come all to the auction of frustration.

About now, I am setting personal expectations for 10 pm next Tuesday, then I can't possibly be disappointed.

LuC1ll3atTh3Wh33L

wheel of fortune and jeopardy w/dinner tonight instead of teso.
maybe some laundry while i'm watching. BIG MONEY!!
then some medicinal before a pre-bedtime nap.
then some medicinal before bed.
and because of my age, several trips to the bathroom over the course of the night.
Thank you.

Xenite

Great launch to a new expansion.

This is starting to become a far to regular occurrence.....

KitsuneShoujo

Lysette wrote: »

wenchmore420b14_ESO wrote: »

ZoS wants to surprise us with a brand new character creation addition.
Get a peak of it here. Enjoy!! Lmao!!
https://www.youtube.com/watch?v=PgowBLb4sKw&list=PLgAMhJBJInPdFMVCMfT-N_OEeaUK9YLuH&index=114&t=2s

haha, protein-folding - that got it for me - lol. Takes ages to compute, bring a supercomputer.

OMG I love the Onion youtube channel! I didn't know they were making new stuff.
"If your character has any anatomical flaws they could die!" lol

Also My NEXT near-miss prediction for the next extension will be 9pm!

prof_doom

Lovely. Maybe we can get our ESO+ subs extended a day to make up for it.

Tornaad

I am looking forward to the letter @ZOS_MattFiror will likely be posting after this mess. I suspect it will be wonderfully informative, and that he might even be working on it right now.

wenchmore420b14_ESO

KitsuneShoujo wrote: »

Lysette wrote: »

wenchmore420b14_ESO wrote: »

ZoS wants to surprise us with a brand new character creation addition.
Get a peak of it here. Enjoy!! Lmao!!
https://www.youtube.com/watch?v=PgowBLb4sKw&list=PLgAMhJBJInPdFMVCMfT-N_OEeaUK9YLuH&index=114&t=2s

haha, protein-folding - that got it for me - lol. Takes ages to compute, bring a supercomputer.

OMG I love the Onion youtube channel! I didn't know they were making new stuff.

Actually this is from ESO launch, but I thought we all needed a little laugh while waiting on servers...

shadyjane62

I am out of ice cream.

OlyGregg

prof_doom wrote: »

Lovely. Maybe we can get our ESO+ subs extended a day to make up for it.

SilverBride

When I used to play Ultima Online, if our server went down a group of us would go to another server, create a character with a long beard named Bob, dress him in underwear and a cape and attack players as they left town. We actually managed to kill a player once.

Aehallh

What I think is nice is being thanked for my continued patience. Well if they could just hear what I'm yelling at them.....................

shadyjane62

On WoW we used to go another server and make Level one gnomes and march to Westfall to attack Hogger.

K9002

I expected it to be unplayable today, but now I'm worried it might be barely playable for the next week or longer, like U33. Guild traders also flip tomorrow and not all guild leaders made their bids yet.

Holycannoli

Wow until 7?

Something screwed up BAD. I want to be a fly on wall listening to these techs dealing with it right now lol.

Nulami

K9002 wrote: »

I expected it to be unplayable today, but now I'm worried it might be barely playable for the next week or longer, like U33. Guild traders also flip tomorrow and not all guild leaders made their bids yet.

I expect emergency downtime tomorrow that will last most of the day. But NA only for the majority of it.

Tornaad

SilverBride wrote: »

When I used to play Ultima Online, if our server went down a group of us would go to another server, create a character with a long beard named Bob, dress him in underwear and a cape and attack players as they left town. We actually managed to kill a player once.

lol
That is funny and almost makes me want to go create a throw away character on the EU server.

Redguards_Revenge

I just finished playing "find the wireless mouse" which was wedged between my bed and inside a row of hangers I didn't bother moving...ahh 2 hours well spent. Cleaned up the room while searching.

Nulami

Holycannoli wrote: »

Wow until 7?

Something screwed up BAD. I want to be a fly on wall listening to these techs dealing with it right now lol.

ESO is now a Microsoft product. Should "stabilize" when Service Pack 1 releases....

SilverBride

Zuboko wrote: »

SilverBride wrote: »

When I used to play Ultima Online, if our server went down a group of us would go to another server, create a character with a long beard named Bob, dress him in underwear and a cape and attack players as they left town. We actually managed to kill a player once.

lol
That is funny and almost makes me want to go create a throw away character on the EU server.

I thought about that too. haha

KitsuneShoujo

shadyjane62 wrote: »

On WoW we used to go another server and make Level one gnomes and march to Westfall to attack Hogger.

I remember that... or the gnome trains to Ogrimarr. Those were the days.