U41 Guild History problems

hiyde

OMG is this finally over???

For the first time, I was able to log in and update data without anything getting stuck. <fingers crossed>

clacker

Looking good so far.

erdbeerheld

As I was redirected to this thread in my support ticket, I am trying to follow up on this discussion, as this thread here seems to have more visibility.

Since U41 various players have encountered long loading screens, when using a door, portal or wayshrine with the same zone.

I was able to trace this back to the guild history cache files, and the way they are updated by the game. For any of the above scenarios, the files are completely wiped/emptied (0KB filesize) and then the full data is redumped into the files. It doesnt matter how much new guild history data has been retrieved from the server, the process is always the same. The more history data has been retrieved over time, the longer this process takes. (This has peaked for me in 60 seconds to just use the door to the bank in Leyawiin.)

I am a little surprised, that this issue has not been raised more often. Or whether it is just "accepted". Or whether there are other factors, that make this less common. While I do have a "workaround" for this recurring scenario (delete cache files, when they start getting too big and causing this issue), I am looking for a better option.

@sirinsidiator @Sharlikran Do you know if the GuildHistoryCacheMaxNumberOfDays_* values in UserSettings.txt can be configured to a lower (supported) value than what is possible within the LibHistoire UI? So esp. less than 30 days for the guild trader section.

Auberon1983

Fingers crossed we get the fix tomorrow (PS/NA), and Xbox too. We're not even a trading guild and it's a right nuisance, I can only imagine how bad it is for traders.

valenwood_vegan

Still doesn't work right. Was all fixed and looking good after the patch, but back to this one day later.

Sharlikran

@erdbeerheld ZOS did see your post and did some testing but suffice it to say, there was no significant impact saving guild history with even 50k events. Myself I run around 150K events.

I must stress I am the lowest common denominator and may not even be able to develop mods in the coming months because I have a family of 7 and I don't have 1200 dollars to buy a new PC with an M2 SSD and all the newest stuff.

https://pastebin.com/JmtgwCnD

That is my system and I'm using windows 7. Sirinsidiator joked with me the other day that his video card has more ram than my system.

I did a series of entering and leaving the bank in Leyawiin.

1st time entering : 50.17 seconds
1st time leaving : didn't time it but it probably took about the same

without logging out, 30 days of history minus what I was missing for the last 18 or so hours

2nd time entering : 11.13 seconds
2nd time leaving : didn't time it but it probably took about the same

Logged out to character screen, 30 days of history minus what I was missing for the last 18 or so hours

3rd time entering : 20.80 seconds
3rd time leaving : 01:19.99, over a minute

without logging out, but requested guild history, 30 days of history

4th time entering : 01:01.32, over a minute
4th time leaving : 26.78 seconds

without logging out

5th time entering : 01:08.45, over a minute
5th time leaving : 5.65 seconds

Disabled all mods, and reloaded the UI

6th time entering : :56.73 seconds
6th time leaving : 5.27 seconds

Exited the game , deleted guild history cache, no mods

7th time entering : :56.73 seconds
7th time leaving : 5.27 seconds

logged in, no cache, no mods

8th time entering : :16:42 seconds
8th time leaving : 8.86 seconds

Enabled addons, reloaded UI, no cache

9th time entering : 15:06 seconds
9th time leaving : 16:42 seconds

without logging out, but requested 1 day of guild history

10th time entering : 6.31 seconds
10th time leaving : 5:13 seconds

without logging out, without requesting more history

11th time entering : 6.37 seconds
11th time leaving : 6:98 seconds

without logging out, but requested 10 days of guild history

12th time entering : 9.93 seconds
12th time leaving : 8.74 seconds

without logging out, but requested 30 days of guild history

13th time entering : 01:16.55, over a minute
13th time leaving : 19.78 seconds

without logging out

14th time entering : 01:03.51, over a minute
14th time leaving : 8.87 seconds

without logging out

15th time entering : 3.36 seconds
15th time leaving : 58.47 seconds

without logging out

16th time entering : 3.36 seconds
16th time leaving : 3.50 seconds

I cannot get the game to give any consistent results. ZOS did see what you mentioned, but the way the binary cache works there isn't any significant affect it has on load times. Neither you nor I could every really test only, and exclusively, the saving of the guild cache.

I'm getting all different load times. I am sure there are all sorts of factors but I don't have a way to specifically target how long it takes to save the guild history. Granted I have a few times at about 1 minute, but with mods and 30 days of data I would have 5 to 20 seconds also.

I understand that every time there is a mod or game update people find things like this that change and they look for something to explain the change. I understand but this is not the first time someone has mentioned loading times between 30 seconds to 60 seconds.

I wish you could all feel my pain, with mods it takes anywhere from 3 to 5 minutes for me to reload the UI. If I'm developing mods and and I forget to put a comma ',' or a bracket '{}' somewhere and I ALT TAB out and notice it, I can usually fix it before the UI reloads, but then I have to wait another 3 to 5 minutes to reload the UI again because I fixed it while the UI was reloading.

Sorry you are experiencing that but ZOS and myself can't see how it could be the binary cache.

Sharlikran

valenwood_vegan wrote: »

Still doesn't work right. Was all fixed and looking good after the patch, but back to this one day later.

So far myself and hundreds of guild members have no issues. I'm still looking into something but I would need some information from you. It's simple but I would prefer to go over it and the steps on ESOUI.

https://esoui.com/forums/showthread.php?t=10879

Post in that thread please.

Sharlikran

erdbeerheld wrote: »

Do you know if the GuildHistoryCacheMaxNumberOfDays_* values in UserSettings.txt can be configured to a lower (supported) value than what is possible within the LibHistoire UI? So esp. less than 30 days for the guild trader section.

As far as settings goes, again there isn't a significant impact with 150K events for me on my well under spec PC.



I don't see how you could get the settings lower than what is in LibHistoire without personal modifications. You could clear the cache for categories you don't want but I don't see this helping you with load times when there are many other factors.

I don't recommend altering UserSettings.txt because other things will change what you set. If you mark it read only I can't guarantee that won't cause creative issues.

Lillisia

I am having an issue also but not quite sure what is causing it.

@sirinsidiator @Sharlikran @Zos_Frank

When I first log on I do the Guild History thing across the 4 Guilds I am in (for Lib Historie), 2 of the 4 have Traders, which usually creates a traffic jam in it.
Then I go to a banker so I can either add stuff to sell in the guilds or I just scan the guilds with traders to keep the listings fresh on the TTC client.
Then I do it once more sometime later (usually when I am having problems with ATT not recognizing that I sold something hours ago or even a day ago in a guild ).
I reload UI and then I get this error and can't do anything other than to log out of the game and even that gives me issues.
I need help figuring this out please. It is happening every time I scan the guilds with traders for the TTC client.



I had to quit the game because it wouldn't even let me just log out to character screen.
I ran Repair on the Game Launcher.
I logged back in to the game.
And once I logged back in all was fine for the rest of my gaming time that day.

However, I experienced the same Error as above the next day.
This time after quitting the game, running repair, and logging back in, I disabled all but TTC and LibHistorie while on the Character Screen, did a /reloadui, and entered the game.
Once in, I ran LibHistorie, causing a traffic jam once again when I did the requests for Guild History.
Then I rescanned my Trading Guilds to see if I could replicate the Error upon doing a /reloadui (typed in manually this time).
And sure enough it happened again.

The next day I tried something a bit different.
This time I closed my Inventory before hitting the /reloadui icon on the top of my Chat box.
And I got no Error.
I tried it once again, this time typing /reloadui manually and still no error.

Now in the past I was always able to hit the /reloadui icon on my chat box, or type it in manually, with my inventory still open after doing a guild scan for TTC, but it seems that I am no longer able to do that.

Did something change along those lines?

***To clarify, when I say "caused a traffic jam" I am referring to getting the Orange color on one of the requests (usually the Trader part of 1 of the 2 Guilds I am in whom have a Trader, or both.

EF321

Ok, so it seems that not loading your history as soon you loaded into the game might be an issue.
I usually load history once I am in, and I haven't had problems even prior to latest update.

Just now I picked a character and went afk for 5 minutes, came back to everything in history being stuck, something I haven't seen in a while.
I fully logged out from account (not just character), loaded again and was able to load everything without clearing cache.

Tallon_IV

EF321 wrote: »

Ok, so it seems that not loading your history as soon you loaded into the game might be an issue.
I usually load history once I am in, and I haven't had problems even prior to latest update.

Just now I picked a character and went afk for 5 minutes, came back to everything in history being stuck, something I haven't seen in a while.
I fully logged out from account (not just character), loaded again and was able to load everything without clearing cache.

This has been my experience too. Since I started going straight to my history after logging in, I haven't had loading issues. If I forget or AFK, then it almost always breaks.

Lillisia

EF321 wrote: »

Ok, so it seems that not loading your history as soon you loaded into the game might be an issue.
I usually load history once I am in, and I haven't had problems even prior to latest update.

Just now I picked a character and went afk for 5 minutes, came back to everything in history being stuck, something I haven't seen in a while.
I fully logged out from account (not just character), loaded again and was able to load everything without clearing cache.

If you were responding to me then you didn't notice that the first thing I said is this...
"When I first log on I do the Guild History thing across the 4 Guilds I am in (for Lib Historie), 2 of the 4 have Traders, which usually creates a traffic jam in it."

It's always the first thing I do when I log on each day.

Seravi

Found this thread trying to figure out my new issue. After the 9.3.8 patch I no longer see current guild history. I also have another new issue that I keep getting notifications the daily message has changed when it hasn't. I click to delete the notification but as soon as I log into another character or travel the notification is back.

I checked with our GM and he said guild history had updated as little as two minutes before I asked about the issue in chat. My guild history is stuck at three days ago with no new updates.

I opened a bug report in the forum and sent in a bug ticket. I don't use addons so that isn't the issue. PCNA

Sharlikran

EF321 wrote: »

Ok, so it seems that not loading your history as soon you loaded into the game might be an issue.

https://www.esoui.com/forums/showthread.php?t=10879

Please post in that forum and I will go over what information I'm looking for in regards to this.

Sharlikran

Tallon_IV wrote: »

This has been my experience too. Since I started going straight to my history after logging in, I haven't had loading issues. If I forget or AFK, then it almost always breaks.

https://www.esoui.com/forums/showthread.php?t=10879

Please post in that forum and I will go over what information I'm looking for in regards to this.

erdbeerheld

Sharlikran wrote: »

I cannot get the game to give any consistent results. ZOS did see what you mentioned, but the way the binary cache works there isn't any significant affect it has on load times. Neither you nor I could every really test only, and exclusively, the saving of the guild cache.

I'm getting all different load times. I am sure there are all sorts of factors but I don't have a way to specifically target how long it takes to save the guild history. Granted I have a few times at about 1 minute, but with mods and 30 days of data I would have 5 to 20 seconds also.

Thanks for your extensive testing @Sharlikran , I wasnt expecting you to spend so much time on it, but much appreciated. I was just hoping for the information to be more visible to ZoS. But as you mentioned, that is already the case, so thats good.

I agree, it is not 100% consistent, which makes it difficult to "prove" anything. With regards to more "hard" evidence, I will continue testing on my end and see if I can provide some more meaningful numbers for ZoS. As ESO doesnt run with Process Monitor active, I will have to be a little more creative.

Thanks again for your time and effort

Lillisia

Ok. I went and installed MM along with 2 of it's Libs that I didn't have. So now I have AGS, ATT, TTC, LGR and MM.

I thought it was going to turn out to be a good idea because my ping stabilized and I was actually getting messages and mails that I had sold stuff.
Now I have more problems than I did before.

As soon as I went to the Banker and clicked on the Guild Store, I was met with a black box on the right side of my screen where the guild stores should show up at.
Closed it and tried the banker > guild store option once again and was met with the same thing. But this time it wouldn't let me close the window or Esc. I had to hard shut down my game.

Here is a screenshot of what I saw the first time I opened the guild store via the banker:


After doing a repair on the game and logging back in I tried once again to reach the guild store screen. Same thing. Just a black screen as seen above.
But this time I noticed something else that I hadn't noticed before...I can't use Enter to be able to get to my desktop any more.
I actually have to use Ctrl Alt Delete.

My minimap, CP bar, skill bar, FPS and Ping watcher, my clannfear and Sharp's bars, Exp Notify, Rare fisherman, my buffs bar are all missing! I also get no options on the left side when I press Esc. so I can't log out or anything.


If someone won't help me figure out what the problem is I am just going to uninstall everything Trading related and leave the 2 Trading guilds I am in.
I am beyond fed up at this point.
It's ruining my enjoyment and gaming experience.
Please someone help me @Zos_Frank @Sharlikran @sirinsidiator

Edit just noticed my Notifications icon was blinking so I thought I would check it being that I am still in the game.
Guess what... this is what I see when I clicked to open Notifications:
nothing but a black box

I can't collect mail either O.O
It's just all black as well.

UPDATE I uninstalled MM via Minion and now this is what I see:


It seems that MM and something else I have installed are conflicting.
And the Notification that I never could see is now gone.

Sharlikran

erdbeerheld wrote: »

I was just hoping for the information to be more visible to ZoS. But as you mentioned, that is already the case, so that's good.

I wouldn't test anything. I can't speak for them but I do not feel there is anything else to test in regards to Guild History.

Sharlikran

Seravi wrote: »

Found this thread trying to figure out my new issue. After the 9.3.8 patch I no longer see current guild history.

This is sometimes the case. It would not be the first time I have heard of this and it is user specific. It is between you and the server. Nothing you can really do about that.

Seravi wrote: »

I also have another new issue that I keep getting notifications the daily message has changed when it hasn't.

Not guild history related and also not something you can do much about. There are mods to suppress that. I have know it to always be that way but, like I said not guild history related.

Seravi wrote: »

I opened a bug report in the forum and sent in a bug ticket. I don't use addons so that isn't the issue. PCNA

I understand that you don't use mods but in your case without them there isn't much you can do at this point. There have been two incremental patches so far that for the majority of people seem to correct previous issues. However, they are using a UI provided by LibHistoire to clear the ZOS cache.

If you prefer not to use mods then you will need to go to:

C:\Users\[user anme]\AppData\Local\Elder Scrolls Online\live\CachedData\GuildHistory

Do not delete the GuildHistory folder itself, as it will not be recreated, only delete its contents.

If that doesn't address you issue then you would need to install some mods and provide me with some debug information from them in order to see if you have an issue I am still collecting data for.

Sharlikran

@Lillisia Thanks for all the details but what you are reporting isn't only about Guild History. You are performing multiple steps that are not part of the vanilla UI like scanning the Kioks with AGS. The errors in the screen shots you provided are from ZOS internal code and not related to Guild History at all. I see Quest and Inventory and so on. The errors are occurring due to incorrect use of ZOS code.

I am happy to help but if you would be so kind as to respect the process, as this is off topic for this thread.

I would also like to help you preserve your sanity a bit. Stop repairing the game to resolve this error. It's not going to help. Sometimes reinstalling mods is a great step to take because Minion may not install them properly. As a precaution I have suggested that many times. Running repair isn't recommended in your case.

I am sorry you are frustrated and your game play is difficult with this issue but that's part of the responsibility users accept when installing mods.

https://esoui.com/forums/forumdisplay.php?f=164

I am happy to make suggestions, start a thread in that forum and we can go form there.

Fair warning though, you will have your work cut out for you. Mod authors do not have permissions and cannot fix other author mods and upload fixes as we don't have permission to do so. Most likely you will have to uninstall some mods to get to a working state.

Lillisia

Sharlikran wrote: »

@Lillisia Thanks for all the details but what you are reporting isn't only about Guild History. In fact the errors in the screen shots you provided are from ZOS internal code and not related to Guild History at all. I see Quest and Inventory and so on. The errors are occurring due to incorrect use of ZOS code.

Yeah I am not sure what caused that error but it worked itself out and all is fine with it now.

I am happy to help but if you would be so kind as to respect the process, as this is off topic for this thread.

I would also like to help you preserve your sanity a bit. Stop repairing the game to resolve this error. It's not going to help. Sometimes reinstalling mods is a great step to take because Minion may not install them properly. As a precaution I have suggested that many times. Running repair isn't recommended in your case.

Ok. No more Repairs lol

I am sorry you are frustrated and your game play is difficult with this issue but that's part of the responsibility users accept when installing mods.

https://esoui.com/forums/forumdisplay.php?f=164

I am happy to make suggestions, start a thread in that forum and we can go form there.

Fair warning though, you will have your work cut out for you. Mod authors do not have permissions and cannot fix other author mods and upload fixes as we don't have permission to do so. Most likely you will have to uninstall some mods to get to a working state.

@Sharlikran
I would love to start a thread there but I can't post screenshots on there and I am unsure why.
That's why I have been posting everything here.

And I am sorry if I made you feel like I was solely pointing the finger at LibGuildHistorie. I wasn't.
It's true I have been having a lot of problems with it and miss how much smoother things seemed to run before U41, but I also understand that it has to put a lot of strain on Zos' servers.

I have narrowed my problem down some now incase you didn't see my last post on here. I was updating it just as you made a post on here.
I uninstalled MM via Minion. My UI is all back now. Seems MM was conflicting with something. What, I am still unsure of.
I never could open Notifications to see what the Error was.
And I would like to be able to use MM alongside TTC still.

hiyde

@Lillisia, in case you aren't aware of this, there's an addon or two on Minion/ESOUI that will help you manage active addons.
It's especially helpful for troubleshooting.

You can create groups of addons to toggle on/off. So you could, for instance, group up all "trading" addons and easily toggle.

Hope this helps! Sorry for the troubles you are experiencing.

Baertram's Addon Selector is one that is still actively updated and has lots of downloads:
https://www.esoui.com/downloads/info1161-AddonSelectorSaveAddOnprofilespacks.html

Sharlikran

Lillisia wrote: »

I would love to start a thread there but I can't post screenshots on there and I am unsure why.

Don't worry about it you won't need screenshots.

In fact, while I don't think you need MORE mods, what hiyde suggested is a good idea. Especially for what you are going to need to do.

Sachsen71

So is there ANY tool, add-on, or setting that works now, that allows us to see when guild members joined our guild? Shissu's used to provide that but now it's gone. I used to be able to see the join date and how many days they had been a member, which was indispensable since we promoted based on time in guild. Now I don't know what to do.

U41 was such a disaster, I'm so incredibly frustrated trying to be a GM with one hand tied behind my back.

hiyde

Sachsen71 wrote: »

So is there ANY tool, add-on, or setting that works now, that allows us to see when guild members joined our guild? Shissu's used to provide that but now it's gone. I used to be able to see the join date and how many days they had been a member, which was indispensable since we promoted based on time in guild. Now I don't know what to do.

U41 was such a disaster, I'm so incredibly frustrated trying to be a GM with one hand tied behind my back.

ITTsRosterBot still seems to work for me (though not 100% of the time). I do see some members (including brand new ones) where there's no info in the tooltip.

Garkbit

Now that the history seem to be working properly, can someone tell me how to start tracking everything again? I turned off the history for everything except trading (while we had all the problems) and can't remember how to turn them back on again!

SilverBride

Garkbit wrote: »

Now that the history seem to be working properly, can someone tell me how to start tracking everything again? I turned off the history for everything except trading (while we had all the problems) and can't remember how to turn them back on again!

Click the gear icon next to each category and choose automatic from the drop down menu.

Sharlikran

Garkbit wrote: »

Now that the history seem to be working properly, can someone tell me how to start tracking everything again? I turned off the history for everything except trading (while we had all the problems) and can't remember how to turn them back on again!

If you do not use a mod named Advanced Member Tooltip then there are no mods using the other categories. Leave them all on Force Off.




Then for Trader use Automatic for each guild.

Sachsen71

Can anyone help me understand what I need to do to fix this? I get this popup every time I log out now. I have tried setting my categories to Automatic and also to Force On but the popup is there either way. I poked around in the settings and couldn't find anything that seemed relevant. TIA

Garkbit

Sharlikran wrote: »

If you do not use a mod named Advanced Member Tooltip then there are no mods using the other categories. Leave them all on Force Off.

Thanks Sharlikran