Update 40 featuring the Endless Archive is now available to test on the PTS! You can read the latest patch notes here: https://forums.elderscrollsonline.com/en/categories/pts
Maintenance for the week of October 2:
• PC/Mac: NA and EU megaservers for patch maintenance – October 2, 4:00AM EDT (8:00 UTC) - 9:00AM EDT (13:00 UTC)
• ESO Store and Account System for maintenance – October 3, 9:00AM EDT (13:00 UTC) - 12:00PM EDT (16:00 UTC)
• Xbox: NA and EU megaservers for patch maintenance – October 4, 6:00AM EDT (10:00 UTC) - 12:00PM EDT (16:00 UTC)
• PlayStation®: NA and EU megaservers for patch maintenance – October 4, 6:00AM EDT (10:00 UTC) - 12:00PM EDT (16:00 UTC)

Official Discussion Thread for "Update 33 Preview- Account-Wide Achievements and More"

  • Kiyakotari
    Kiyakotari
    ✭✭✭✭✭
    "With the database’s overall footprint reduced, it will more performant across the board, which may manifest itself in faster load screens and improved performance on other database-heavy operations."

    Your editors are slacking.
  • FrancisCrawford
    FrancisCrawford
    ✭✭✭✭✭
    ✭✭✭✭
    Responses inline, in ALL CAPS.
    More precisely, it's either an outright lie or -- more likely -- a confession of staggering technical ignorance or incompetence.

    They mention "over 1 billion achivements" over the course of the game. Well, each of those achievements requires on average a few bytes of memory to track. So they might save perhaps 3 gigabytes of disk storage by making this massive change. That's not per player; that's 3 GB ACROSS THE ENTIRE PLAYER BASE. That's so trivial that even ZoS wouldn't care.

    But even there, a few hundred data fields per character are a triviality to load in any halfway sensible database architecture.
    I'm not convinced of a billion achievements, but this game is big enough that it's well over a thousand achievements by now, possibly heading for 10k?

    THEY OBVIOUSLY WERE REFERRING TO ALL PLAYERS, CHARACTERS AND ACCOUNTS, NOT JUST ONE.

    That said, the bigger issue is that each achievement requires tracking a LOT of data, in a system that had to be designed from the start to be able to add more achievements.

    Consider skyshards alone - we're at around 40 zones, with a total of 501 skyshards. Since the skyshard achievements are not fixed (more can be added), this is not a simple binary number to track them. Instead, you need a database with (at minimum) fields like an index field, a key identifier for the account, a character identifier, a zone identifier/index, plus some field per skyshard (have you got it or not), plus at least one reference identifier/index for the database which tracks achievement names/types etc. So, since it's a 64-bit system, this is at minimum something like 501 records per character of 6 bytes (64 bits each), times an average of maybe 5 characters per account (guessing). So, 15kB times 20 million-ish accounts would be 300GB-ish? (much of this is split across different megaservers/platforms of course). Let's assume that the Skyshards achieve is unusually large and make the average total storage needed per achievement closer to 100GB instead. Multiply by 1000+ achievements, and we're into hundreds of TB already; heading into Petabyte range if there are more achievements (and there are always more achievements with each new DLC) or more characters on average per account.

    YOU SEEM TO BE ASSUMING A NORMALIZED RELATIONAL SCHEMA IN YOUR SKYSHARDS EXAMPLE. BY WAY OF CONTRAST, IN CASSANDRA OR HBASE ONE COULD COME A LOT CLOSER TO 1 BIT PER SKYSHARD. AND OF COURSE, ONE CAN DENORMALIZE WHEN USING A RELATIONAL SYSTEM AS WELL.

    THE SAME WOULD BE TRUE OF SOME OF THE OTHERS PEOPLE ARE MOST UPSET ABOUT -- DOLMENS, DELVES, ETC.

    ANYHOW, THE NUMBER OF SKYSHARDS, DOLMENS, DELVES, STRIKING LOCALES, AND SO ON IN THE GAME IS SOME HUNDREDS, AND EVEN IN YOUR PREFERRED DATABASE DESIGN THEY COULD BE HANDLED IN ONE RECORD EACH. MOST OTHER ACHIEVEMENTS TRULY ARE MEASURED IN SINGLE NUMBERS, BOOLEAN OR COUNTER AS THE CASE MAY BE.

    Being able to cut this amount of data by 75%-ish (would be 80% if there are an average of 5 characters per, but let's assume it's not entirely clean) seems appealing in terms of managing, indexing, searching, storing/retrieving and backing up that data etc.

    I think you may be off with your estimate by a few orders of magnitude. I might be too, of course - I have no clue how ZoS actually implemented this feature.

    THE QUESTION IS MORE HOW THEY SHOULD HAVE IMPLEMENTED IT. (I SHARE @DarcyMardin's GUESS THAT THIS ALL HAS A LOT TO DO WITH A SYSTEM REDESIGN.

    ALSO, AS NOTED ABOVE, I THINK YOUR EXTRAPOLATION TO ALL ACHIEVEMENTS FROM A PARTICULARLY DATA-INTENSIVE WAY TO IMPLEMENT SKYSHARD ACHIEVEMENTS WAS FLAWED ANYWAY; THERE ONLY ARE A LITERAL HANDFUL OF ACHIEVEMENT TYPES THAT SHARE THE CHARACTERISTIC OF COVERING MANY LOCATIONS PER ZONE.

  • FrancisCrawford
    FrancisCrawford
    ✭✭✭✭✭
    ✭✭✭✭
    mystfit wrote: »
    I was remembering an incident in eq2 years ago when zone loading was getting longer and longer. The issue was related to the fact the older the characters got, the more recipes they got and this was making load times bog down. I don't recall what they did to fix it, if anything, but I can't imagine one crafting class of recipes would be larger than a character's achievement journey, so I'm willing to consider it as a performative change.
    But this sure seems like an aggressive way to address the problem. I suppose in coding an older game, you work with the cards you are dealt but I can't shake the feelings this performative angle is just a hail mary to get us to hush. Why mention it so late? OTOH, we assume they aren't cruel jerks causing pain on purpose...so...sigh...I dunno what to think .
    I feel capable of working with this change and continuing to enjoy my characters, but my heart aches for those who can't.

    Guild Wars, which I think is a little younger than EQ, stored all character data in one long BLOB, or something very close to one. The lead developer's excuse was that, while he'd learned how to write a database management system (DBMS) in college, he hadn't learned how to actually use one.

    The size of the BLOB was, if I recall correctly, on the order of a couple hundred kilobytes.
  • Silufadumar
    Silufadumar
    ✭✭✭
    Could they not have moved the relevant character/achievement data to be saved locally, on our pc's and consoles?

    I know very little about how such things work, just a thought.
  • ElvenOverlord
    ElvenOverlord
    ✭✭✭✭
    Wait, so for example I've collected all the stolen relics for the psijic vault on my templar main what does that mean for my alt characters? Will they still be able to collect and restore the vault or is it automatically restored for them already? Same with the library in Vvardenfell and other similar ones.
    Edited by ElvenOverlord on February 25, 2022 3:50AM
  • FrancisCrawford
    FrancisCrawford
    ✭✭✭✭✭
    ✭✭✭✭
    Could they not have moved the relevant character/achievement data to be saved locally, on our pc's and consoles?

    I know very little about how such things work, just a thought.

    The ostensible issue surely isn't disk storage. It's the effort in reading, writing and/or loading data, or maybe the amount of data kept in memory while a character is online.
    Edited by FrancisCrawford on February 25, 2022 3:38AM
  • Hotdog_23
    Hotdog_23
    ✭✭✭✭✭
    ✭✭
    For me personally I welcome the change. I don’t need some type on a screen to reflect how I view my characters and their personal journey I have created in my own head. FYI, I have played for 7-8 years or however long it has been out on PlayStation. In fact, ESO is the reason I first purchased a PlayStation.

    Have 18 characters and would have more if ZOS allowed more per account. Never deleted a character and never intend too. Each has their own story, history, and journey. Nothing ZOS does can change that. Little white text on the screen does not change that fact for me. For those that are upset and angry by this I am truly sorry you must go thru this.

    PVP reward is nice to see. What is the Tel Var Stones cost going to be? Since it says it is bound to your character does that mean each different character needs to unlock and purchase them to wear the new outfit style. Or once purchased can any character on that account wear it?

    The Deconstruction Assistant - Can fillet fish be added to the decon assistant? Pretty please with sugar on top.

    Question non-related to article. Since you are in the process of rewriting some of the base code any chance you could add the ability to use add-ons for the consoles? After all Skyrim does allow add-ons for consoles.

    Stay safe everyone and Happy Hunting :)
  • Kesstryl
    Kesstryl
    ✭✭✭✭✭
    ✭✭
    Hotdog_23 wrote: »
    For me personally I welcome the change. I don’t need some type on a screen to reflect how I view my characters and their personal journey I have created in my own head. FYI, I have played for 7-8 years or however long it has been out on PlayStation. In fact, ESO is the reason I first purchased a PlayStation.

    Have 18 characters and would have more if ZOS allowed more per account. Never deleted a character and never intend too. Each has their own story, history, and journey. Nothing ZOS does can change that. Little white text on the screen does not change that fact for me. For those that are upset and angry by this I am truly sorry you must go thru this.

    PVP reward is nice to see. What is the Tel Var Stones cost going to be? Since it says it is bound to your character does that mean each different character needs to unlock and purchase them to wear the new outfit style. Or once purchased can any character on that account wear it?

    The Deconstruction Assistant - Can fillet fish be added to the decon assistant? Pretty please with sugar on top.

    Question non-related to article. Since you are in the process of rewriting some of the base code any chance you could add the ability to use add-ons for the consoles? After all Skyrim does allow add-ons for consoles.

    Stay safe everyone and Happy Hunting :)

    Be prepared to have game sound turned off, and voice acted dialogue too, because it's not just little white text, but how the game world NPCs react to you as you walk by them. If you don't care about that, then, be prepared to be locked out of any quests tied to achievements on alts. Someone on PTS found the main quest in Stros M'Kai is not able to progress on alts due to this. We don't know how many more quests like this are broken.
    HEARTHLIGHT - A guild for housing enthusiasts! Contact @Kesstryl in-game to join.
  • FrancisCrawford
    FrancisCrawford
    ✭✭✭✭✭
    ✭✭✭✭
    Kesstryl wrote: »
    Hotdog_23 wrote: »
    For me personally I welcome the change. I don’t need some type on a screen to reflect how I view my characters and their personal journey I have created in my own head. FYI, I have played for 7-8 years or however long it has been out on PlayStation. In fact, ESO is the reason I first purchased a PlayStation.

    Have 18 characters and would have more if ZOS allowed more per account. Never deleted a character and never intend too. Each has their own story, history, and journey. Nothing ZOS does can change that. Little white text on the screen does not change that fact for me. For those that are upset and angry by this I am truly sorry you must go thru this.

    PVP reward is nice to see. What is the Tel Var Stones cost going to be? Since it says it is bound to your character does that mean each different character needs to unlock and purchase them to wear the new outfit style. Or once purchased can any character on that account wear it?

    The Deconstruction Assistant - Can fillet fish be added to the decon assistant? Pretty please with sugar on top.

    Question non-related to article. Since you are in the process of rewriting some of the base code any chance you could add the ability to use add-ons for the consoles? After all Skyrim does allow add-ons for consoles.

    Stay safe everyone and Happy Hunting :)

    Be prepared to have game sound turned off, and voice acted dialogue too, because it's not just little white text, but how the game world NPCs react to you as you walk by them. If you don't care about that, then, be prepared to be locked out of any quests tied to achievements on alts. Someone on PTS found the main quest in Stros M'Kai is not able to progress on alts due to this. We don't know how many more quests like this are broken.

    And woe to you if you care about alliance identities, but relaxed that for Cadwell's Silver/Gold. For if one of your characters has fought off the evil DC invaders in Stonefalls, now all of them presumably will have, and can expect to be repatedly thanked for doing so.
    Edited by FrancisCrawford on February 25, 2022 9:50PM
  • Christerra
    Christerra
    Soul Shriven
    Personally, I'm really happy with this upcoming update. I am curious to know if skyshards will be part of the account-wide achievements. Fingers crossed that they are! No more running around getting skyshards on thirty-four toons would be amazing!
  • Araneae6537
    Araneae6537
    ✭✭✭✭✭
    ✭✭✭✭
    Christerra wrote: »
    Personally, I'm really happy with this upcoming update. I am curious to know if skyshards will be part of the account-wide achievements. Fingers crossed that they are! No more running around getting skyshards on thirty-four toons would be amazing!

    No, you still have to get those on each character individually, at least for the actual skill points, Idk about the achievement.
  • Christerra
    Christerra
    Soul Shriven
    Christerra wrote: »
    Personally, I'm really happy with this upcoming update. I am curious to know if skyshards will be part of the account-wide achievements. Fingers crossed that they are! No more running around getting skyshards on thirty-four toons would be amazing!

    No, you still have to get those on each character individually, at least for the actual skill points, Idk about the achievement.

    Thank you for the quick reply @Araneae6537. I guess the grind is still real! No matter. I love this game!
  • alberichtano
    alberichtano
    ✭✭✭✭✭
    Lauranae wrote: »
    This is the second game which decided to mess up with players and ruin a game. FIrst one on Feb 15 2022 and eso soon too.

    The other game lost already a lot of subs. They did exactly as ESO (or ESO did exactly as them) and revamped the game in their view, but in fact destroyed it.

    Both games took arbitrary decisions, ignored the PTS, and vague of unsubs. (the first game delivered a patch with a list of bugs longer than a patch notes) and it seems that ESO is doing the same.

    So i understand, less data = more space on servers BUT with all the subs you have and the crown store sells, are you telling us that you are short on money to add more server ??? and that the only solution is to cut on the fun of your players ??

    Dont you see the ridicule here ? you want more players, though you are making the game less appealing.
    When the new players will have replaced those who quit, and they will realise there is not reason to create alts, what will happens ? They will take more and more break from the game and only come back for a new expansion.

    Well done!!

    Oh and i forgot!!! my advice to all those who spent their time testing on the PTS, stop testing, that will change nothing.


    as a lot of us, i have several account (3) and i enjoy all my characters. Some are only crafters and i dont want them to appear in game as Hero. They are simple people. Some have their own story in your story .

    So you are actually advertising the game as it was before https://www.elderscrollsonline.com/en-us/discover, when in fact half of the promess on that page are now a total lie.

    If i was tempted to stay, that would mean for you : 1 sub, not 3. No new outfitting, no new houses, no new mount needed, nore pets. One character does not need more as i would not play the other characters at all.


    Now that i think about, did Microsoft acted with Zenimax Media and enforced those changes ?

    I am wondering the same thing. MS will of course want profits from their new purchase, and that may mean cutbacks. :/
  • alberichtano
    alberichtano
    ✭✭✭✭✭
    There has to be another way to improve performance. What about all of these server upgrades ZOS was talking about earlier? We can't at least see if that allows for character specific data to be kept? Where does all that subscription money go; you can't maybe use that to improve the game's database performance in a way that doesn't destroy the most important aspect of a role playing game?

    I may be wrong here, but I believe those were mentioned before Microsoft bought ZOS. MS might not be so interested in spending more money on their purchase, but rather see profit come in from it. But again, I may be mistaken.
  • WiseSky
    WiseSky
    ✭✭✭✭✭
    ✭✭
    So Sad to see that my level 2 mule char will be greeted as the hero by all the NPCs!

    Would it be possible to have a Check Mark next to the Achievement that makes it possible to Check it or UnCheck it so that NPCs can react accordingly ?
    Immersive Quests Addon
    Wish to Quest without Quest Way Markers? ''Talk to the Hooded Figure'' Turns into ''Talk to the Hooded Figure, who is feeding the chickens near the southeastern gate in the city of Daggerfall in Glenumbra.'' If you Wish To write bread crumbs clues for quest for other players to experience come join the team!
    List of Immersion Addons
  • Dojohoda
    Dojohoda
    ✭✭✭✭✭
    ✭✭✭
    WiseSky wrote: »
    So Sad to see that my level 2 mule char will be greeted as the hero by all the NPCs!

    Would it be possible to have a Check Mark next to the Achievement that makes it possible to Check it or UnCheck it so that NPCs can react accordingly ?

    That's a negative. Character data will be removed, thereby rendering your mule into a hero. From then on out, your non-achievers will cause sparkly eyes and admiration from the citizens of Tamriel.
    Fan of playing magblade since 2015. (PC NA)
    Might be joking in comments.
    -->(((Cyrodiil)))<--
  • nightstrike
    nightstrike
    ✭✭✭✭✭
    There has to be another way to improve performance. What about all of these server upgrades ZOS was talking about earlier? We can't at least see if that allows for character specific data to be kept? Where does all that subscription money go; you can't maybe use that to improve the game's database performance in a way that doesn't destroy the most important aspect of a role playing game?

    I may be wrong here, but I believe those were mentioned before Microsoft bought ZOS. MS might not be so interested in spending more money on their purchase, but rather see profit come in from it. But again, I may be mistaken.

    Wouldn't MS just tell them to migrate from AWS to Azure?
    Warning: This signature is tiny!
  • gddanielb16_ESO
    @Kesstryl @ZOS_GinaBruno

    Thank you kindly for setting me straight. Literally woke up in the middle of the night worried about what should be entertainment. Crazy, right?
  • alberichtano
    alberichtano
    ✭✭✭✭✭
    There has to be another way to improve performance. What about all of these server upgrades ZOS was talking about earlier? We can't at least see if that allows for character specific data to be kept? Where does all that subscription money go; you can't maybe use that to improve the game's database performance in a way that doesn't destroy the most important aspect of a role playing game?

    I may be wrong here, but I believe those were mentioned before Microsoft bought ZOS. MS might not be so interested in spending more money on their purchase, but rather see profit come in from it. But again, I may be mistaken.

    Wouldn't MS just tell them to migrate from AWS to Azure?

    Sorry, I have no idea what Azure is. But I guess it depends on the costs involved?
  • Kiyakotari
    Kiyakotari
    ✭✭✭✭✭
    Kiyakotari wrote: »
    "With the database’s overall footprint reduced, it will more performant across the board, which may manifest itself in faster load screens and improved performance on other database-heavy operations."

    Your editors are slacking.

    Not badly. The word "be" is missing, but "performant" is a legitimate term that has been widely used for quite a while.

    You're right, sorry, I meant to indicate that with the "be" missing, the word "performant" does not make sense and the sentence doesn't parse. I wasn't clear.
  • WhiteCoatSyndrome
    WhiteCoatSyndrome
    ✭✭✭✭✭
    ✭✭✭
    There has to be another way to improve performance. What about all of these server upgrades ZOS was talking about earlier? We can't at least see if that allows for character specific data to be kept? Where does all that subscription money go; you can't maybe use that to improve the game's database performance in a way that doesn't destroy the most important aspect of a role playing game?

    I may be wrong here, but I believe those were mentioned before Microsoft bought ZOS. MS might not be so interested in spending more money on their purchase, but rather see profit come in from it. But again, I may be mistaken.

    Wouldn't MS just tell them to migrate from AWS to Azure?

    Sorry, I have no idea what Azure is. But I guess it depends on the costs involved?

    Microsoft Azure == Cloud service.
    #proud2BAStarObsessedLoony
    PAWS (Positively Against Wrip-off Stuff) - Say No to Crown Crates!
    A useful explanation for how RNG works
  • alberichtano
    alberichtano
    ✭✭✭✭✭
    There has to be another way to improve performance. What about all of these server upgrades ZOS was talking about earlier? We can't at least see if that allows for character specific data to be kept? Where does all that subscription money go; you can't maybe use that to improve the game's database performance in a way that doesn't destroy the most important aspect of a role playing game?

    I may be wrong here, but I believe those were mentioned before Microsoft bought ZOS. MS might not be so interested in spending more money on their purchase, but rather see profit come in from it. But again, I may be mistaken.

    Wouldn't MS just tell them to migrate from AWS to Azure?

    Sorry, I have no idea what Azure is. But I guess it depends on the costs involved?

    Microsoft Azure == Cloud service.

    Ah, you mean instead of, or as a supplement to current servers?

    I imagine MS wants to sell or hire Azure resources to clients, not use it for computer games they have already purchased and want to profit from.
Sign In or Register to comment.