The Gold Road Chapter – which includes the Scribing system – and Update 42 is now available to test on the PTS! You can read the latest patch notes here: https://forums.elderscrollsonline.com/en/discussion/656454/

Can someone please explain something to me regarding servers?

Mrtoobyy
Mrtoobyy
✭✭✭✭
I want to know how upgrading a server is done? Is it as simple as replacing hardware in its place or does it require some tinkering/tweaking.

Can replacing parts lead to worse performance? I mean I've changed hardware in computers several times and it has always improved the computer. Is it the same with servers?
  • Elsonso
    Elsonso
    ✭✭✭✭✭
    ✭✭✭✭✭
    Mrtoobyy wrote: »
    I want to know how upgrading a server is done? Is it as simple as replacing hardware in its place or does it require some tinkering/tweaking.

    Can replacing parts lead to worse performance? I mean I've changed hardware in computers several times and it has always improved the computer. Is it the same with servers?

    I cannot say how ZOS does it. The way that I am familiar with will build a second server environment, test it with live data, and then on The Day, backup the "live" environment and restore it to the new environment. Finally, test again, then do the final configuration so that the second server environment is the "live" server environment. Typically, this is done every couple/few years because it is not good to let server hardware get too old, or out of support from the manufacturer.

    The reason to build a second server environment, rather than trying to swap out hardware, is to allow for testing. The new hardware is rarely identical to the old hardware, and that can introduce problems. By building a new system, it allows testing and tuning of configurations and can isolate hardware that is not performing properly or does not work well with others.

    Again, no idea how ZOS does it.
    PC NA/EU: @Elsonso
    XBox EU/NA: @ElsonsoJannus
    X/Twitter: ElsonsoJannus
  • Mrtoobyy
    Mrtoobyy
    ✭✭✭✭
    Elsonso wrote: »
    Mrtoobyy wrote: »
    I want to know how upgrading a server is done? Is it as simple as replacing hardware in its place or does it require some tinkering/tweaking.

    Can replacing parts lead to worse performance? I mean I've changed hardware in computers several times and it has always improved the computer. Is it the same with servers?

    I cannot say how ZOS does it. The way that I am familiar with will build a second server environment, test it with live data, and then on The Day, backup the "live" environment and restore it to the new environment. Finally, test again, then do the final configuration so that the second server environment is the "live" server environment. Typically, this is done every couple/few years because it is not good to let server hardware get too old, or out of support from the manufacturer.

    The reason to build a second server environment, rather than trying to swap out hardware, is to allow for testing. The new hardware is rarely identical to the old hardware, and that can introduce problems. By building a new system, it allows testing and tuning of configurations and can isolate hardware that is not performing properly or does not work well with others.

    Again, no idea how ZOS does it.

    Thank you for the information. So it's not that simple as installing hardware and letting it run? Then when new better stuff comes out just replacing it?
    How come this game is running almost smooth as butter during event/anniversary? How can someone fiddle with the existing installed hardware to "boost" it?
  • Marcus684
    Marcus684
    ✭✭✭✭✭
    Mrtoobyy wrote: »
    Elsonso wrote: »
    Mrtoobyy wrote: »
    I want to know how upgrading a server is done? Is it as simple as replacing hardware in its place or does it require some tinkering/tweaking.

    Can replacing parts lead to worse performance? I mean I've changed hardware in computers several times and it has always improved the computer. Is it the same with servers?

    I cannot say how ZOS does it. The way that I am familiar with will build a second server environment, test it with live data, and then on The Day, backup the "live" environment and restore it to the new environment. Finally, test again, then do the final configuration so that the second server environment is the "live" server environment. Typically, this is done every couple/few years because it is not good to let server hardware get too old, or out of support from the manufacturer.

    The reason to build a second server environment, rather than trying to swap out hardware, is to allow for testing. The new hardware is rarely identical to the old hardware, and that can introduce problems. By building a new system, it allows testing and tuning of configurations and can isolate hardware that is not performing properly or does not work well with others.

    Again, no idea how ZOS does it.

    Thank you for the information. So it's not that simple as installing hardware and letting it run? Then when new better stuff comes out just replacing it?
    How come this game is running almost smooth as butter during event/anniversary? How can someone fiddle with the existing installed hardware to "boost" it?

    If you're on PC, ZOS did a server maintenance right before the event started. I've noticed a clear pattern of the server running great right after a restart, then slowly degrading over the next few weeks until the next restart.

    I just logged off from a 3 hours Cyrodiil session and lag is starting to creep back in, and is worse right now than during the event, even if the campaign isn't totally pop-locked.
  • CiliPadi
    CiliPadi
    ✭✭✭✭
    Marcus684 wrote: »
    If you're on PC, ZOS did a server maintenance right before the event started. I've noticed a clear pattern of the server running great right after a restart, then slowly degrading over the next few weeks until the next restart.

    I just logged off from a 3 hours Cyrodiil session and lag is starting to creep back in, and is worse right now than during the event, even if the campaign isn't totally pop-locked.

    Sounds like a server code memory leak... ?
  • zaria
    zaria
    ✭✭✭✭✭
    ✭✭✭✭✭
    CiliPadi wrote: »
    Marcus684 wrote: »
    If you're on PC, ZOS did a server maintenance right before the event started. I've noticed a clear pattern of the server running great right after a restart, then slowly degrading over the next few weeks until the next restart.

    I just logged off from a 3 hours Cyrodiil session and lag is starting to creep back in, and is worse right now than during the event, even if the campaign isn't totally pop-locked.

    Sounds like a server code memory leak... ?
    Could be, note that this should be very visible in Cyrodil as these instances never shuts down outside of maintenance.
    The overland instances are not so stressed.
    It could also be database who need cleaning.
    Grinding just make you go in circles.
    Asking ZoS for nerfs is as stupid as asking for close air support from the death star.
  • Marcus684
    Marcus684
    ✭✭✭✭✭
    CiliPadi wrote: »
    Marcus684 wrote: »
    If you're on PC, ZOS did a server maintenance right before the event started. I've noticed a clear pattern of the server running great right after a restart, then slowly degrading over the next few weeks until the next restart.

    I just logged off from a 3 hours Cyrodiil session and lag is starting to creep back in, and is worse right now than during the event, even if the campaign isn't totally pop-locked.

    Sounds like a server code memory leak... ?

    Very possible. My limited understanding of programming says that every action we take in the game requires a script to run, and it's basically impossible for every script to run and end 100% perfectly, leaving small bits of code left running in the background doing nothing useful. These bits accumulate over time until they build up to a point that they have a noticeable drag on server resources, which is corrected by restarting the program. I guess this is the infamous "memory leak".

    Ever notice how if you don't reboot your cell phone occasionally, it starts to develop glitches? Same principle.

    Tbf this is coming from a non-programmer, so feel free to doubt.
  • Hamish999
    Hamish999
    ✭✭✭✭✭
    Haven't ZOS said they'll do a code rework/refresh/optimisation once all the server hardware has been upgraded?
    PC-EU
    Do'Zahra - Khajiit - StamDK - AD
    Narese Telvanni - Dunmer - Petsorc - EP
    Anastasie Chastain - Breton - Magplar - DC
    Gashnakh the Lusty - Orc - Stamsorc - AD
    Stands-In-Stoopid - Argonian - Warden Tank - AD
    Talia al-Morwha - Redguard - Stamden - AD
    Makes-Fier-Wrong - Argonian - Stamblade - AD
    Busty-Argonian-Maid - Argonian - Templar Healer - AD
    Alaru Telvanni - Dunmer - Stamplar - AD
    Ko'Raehsi - Khajiit - Magsorc - AD
    Torhild Rock-Chucker - Nord - StamDK - AD
    Drusilla Larouche - Breton - MagDK - AD
    Ko'Khanni - Khajiit - Magden - AD
    Ilithyia Ectorius - Imperial - DK Tank -AD

    Keyboard and mouse FTW!
  • Tenthirty2
    Tenthirty2
    ✭✭✭✭✭
    Hamish999 wrote: »
    Haven't ZOS said they'll do a code rework/refresh/optimisation once all the server hardware has been upgraded?

    This^^^
    First in place is the hardware, THEN rewrite, optimize and rollout code that the new hardware can run more efficiently.

    I think we are in-between now. Much of their hardware upgrades are nearing completion. Later (this year? iirc?) we will start to see upgraded code being rolled out, likely in several cycles over a few months vs all at once.

    Unfortunately I don't have a link to the threads where I saw it mentioned, but apparently the code rewrite is a beast of a task.
    I recall it being mentioned that some sections of the game code were not commented\documented properly and the original programmer(s) were no longer with ZoS. Trying to figure out the workings of some sections was creating a lot of heartburn.

    So I'm pretty sure that is what many of us are experiencing now. The server(s) may have been upgraded, but were still (mostly) running on original code. Post maintenance or anytime the servers get taken down and brought back up, things are sweet for a couple days. Then caches get filled but garbage data isn't purged efficiently, memory leaks, etc and things begin to slow down.

    I do NOT envy their coding teams at all :s
    Edited by Tenthirty2 on May 30, 2023 11:16PM
    • "Some enjoy bringing grief to others. They remind M'aiq of mudcrabs - horrible creatures, with no redeeming qualities."
    • "When my time comes, I will smile. And that will be all." -Sir Nathain Galien
    • IGN: TenThirty2 (PC/PS: NA, PC/PS: EU)
  • Elsonso
    Elsonso
    ✭✭✭✭✭
    ✭✭✭✭✭
    Tenthirty2 wrote: »
    I do NOT envy their coding teams at all :s

    I do. I love difficult programming problems... Especially when someone else does the work and I just supervise. :smile:
    PC NA/EU: @Elsonso
    XBox EU/NA: @ElsonsoJannus
    X/Twitter: ElsonsoJannus
  • vsrs_au
    vsrs_au
    ✭✭✭✭✭
    ✭✭
    Marcus684 wrote: »
    CiliPadi wrote: »
    Marcus684 wrote: »
    If you're on PC, ZOS did a server maintenance right before the event started. I've noticed a clear pattern of the server running great right after a restart, then slowly degrading over the next few weeks until the next restart.

    I just logged off from a 3 hours Cyrodiil session and lag is starting to creep back in, and is worse right now than during the event, even if the campaign isn't totally pop-locked.

    Sounds like a server code memory leak... ?

    Very possible. My limited understanding of programming says that every action we take in the game requires a script to run, and it's basically impossible for every script to run and end 100% perfectly, leaving small bits of code left running in the background doing nothing useful. These bits accumulate over time until they build up to a point that they have a noticeable drag on server resources, which is corrected by restarting the program. I guess this is the infamous "memory leak".

    Ever notice how if you don't reboot your cell phone occasionally, it starts to develop glitches? Same principle.

    Tbf this is coming from a non-programmer, so feel free to doubt.
    It's definitely possible for scripts/programs of a smaller scale to run without memory leaks or errors, *however* when the code gets sufficiently complex and large, memory leaks and other types of bugs start to creep in.
    Given the scale of ESO, it's quite likely ZOS has a very *very* rigorous process for designing, developing, reviewing and testing their code, but because it's very large scale, there will always be bugs, unfortunately.
    PC(Steam) / EU / play from Melbourne, Australia / avg ping 390
  • Mrtoobyy
    Mrtoobyy
    ✭✭✭✭
    Awesome replies guys! Thanks for sharing your knowledge. So judging by what you wrote the recoding and all that stuff may happen as late as the end of the year or even starting the next year?

    I was hoping they would fix this after Necrom release
Sign In or Register to comment.