Test Server

Super_Sonico · August 2014

So here's a fun game a few guildies and I have when a new patch rolls out; count the number of things broken by the patch versus the things fixed by the patch. The results aren't stellar.

I would propose having a test server that everyone can play on that's made to test patches. Consider it a Beta server for new content. Here's a few initial thoughts I have on it.

First: Only one character per account can be on this server. This would keep down alts and multiple alliance joining, etc. This shouldn't be the place you play. The reason for this would be so that when you play on the test server, you're playing for giving feedback, finding bugs, and testing the play of the character you chose. You're not using it for playing the game like you do on the regular servers.

Second: Limited up time. To keep people playing on the regular servers, only have a test server up for a week or less. Take 1.3.3 update for example. Most issues with deployment were realized in the first 48-72 hours. 1.3.4 could have been rolled out to the NA/EU servers with much less complaints if there had been that window to live test the update.

Just an idea. I see a LOT of complaining on these forums. It's disheartening. Instead of having players react negatively to the idea you're interfering with their game, you could have a test server that instead creates the notion that players are helping the development process by finding the problems before they go live.

DenverRalphy · August 2014

You mean, aside from the current PTS?

http://forums.elderscrollsonline.com/categories/pts

Elsonso · August 2014

Yes, the PTS is such a stellar success in finding bugs that we should do it for every weekly patch.

Sorry. Sarcasm. Me bad.

SirAndy · August 2014

The PTS has become a ghost town ...

Super_Sonico · August 2014

@DenverRalphy‌ Is the public test server even running? I have no way to create a new character and choose it as the home for a new character. I don't see any announcements about patches and updates being tested on that server before they are rolled out to the NA/EU servers.

SirAndy · August 2014

Super_Sonico wrote: »

@DenverRalphy‌ Is the public test server even running? I have no way to create a new character and choose it as the home for a new character. I don't see any announcements about patches and updates being tested on that server before they are rolled out to the NA/EU servers.

Did you download the PTS client?
It's a completely separate second game client (another 30+ GB).

I was just on the PTS this last weekend ...
;-)

ers101284b14_ESO · August 2014

If no one uses the PTS or reports on it then they aren't going to find as many bugs as they normally would. Then they have to rely on in house testers who use the same computers every time. Just because it breaks on your computer doesn't mean it breaks on their end or on everyones end. That is the hard part, trying to find out if it really is the game or the machines or the game interacting with the machines.

SirAndy · August 2014

ers101284b14_ESO wrote: »

If no one uses the PTS or reports on it then they aren't going to find as many bugs as they normally would.

And even if you do find and report bugs on the PTS, there is no guarantee anyone at ZOS cares.

Some bugs i reported on PTS over 1 year ago (!) not only made it into the LIVE game but they are still there as of yesterday ...

Super_Sonico · August 2014

ers101284b14_ESO wrote: »

If no one uses the PTS or reports on it then they aren't going to find as many bugs as they normally would. Then they have to rely on in house testers who use the same computers every time. Just because it breaks on your computer doesn't mean it breaks on their end or on everyones end. That is the hard part, trying to find out if it really is the game or the machines or the game interacting with the machines.

Which is why they should find a way to make it more integrated with the main client. The launcher should be able to launch any server with the click of a button. I imagine there could be a pull down menu that selects PTS/NA/EU so that when you launch the game it loads up the proper set of characters.

After someone pointed out the PTS forums, I looked at them and don't see any info on 1.3.3 being tested in any real way on the PTS. Whatever is being tested there doesn't seem meaningful to what's pushed to the EU/NA servers.

If it were limited time/availability to test, I think that would help, as the only time to advance those characters would be during test windows.

SirAndy · August 2014

Super_Sonico wrote: »

The launcher should be able to launch any server with the click of a button. I imagine there could be a pull down menu that selects PTS/NA/EU so that when you launch the game it loads up the proper set of characters.

That's exactly how it currently works ...

But, again, you *need* to download a completely new client since the PTS has a different (usually newer) build. A *lot* of data is different between the PTS and LIVE.
It is physically on a different server with different accounts and different characters.

None of your LIVE characters will ever work on the PTS (or vice versa).
;-)

dcincali · August 2014

The current PTS is not accurate as they only allow you to make 3 of the races for the DC faction. You also have to level up all of your crafting to test out new gear, learn motifs etc.. There is NO WAY to test the content correctly with out being able to copy your current main into it.

ers101284b14_ESO · August 2014

Super_Sonico wrote: »

ers101284b14_ESO wrote: »

If no one uses the PTS or reports on it then they aren't going to find as many bugs as they normally would. Then they have to rely on in house testers who use the same computers every time. Just because it breaks on your computer doesn't mean it breaks on their end or on everyones end. That is the hard part, trying to find out if it really is the game or the machines or the game interacting with the machines.

Which is why they should find a way to make it more integrated with the main client. The launcher should be able to launch any server with the click of a button. I imagine there could be a pull down menu that selects PTS/NA/EU so that when you launch the game it loads up the proper set of characters.

After someone pointed out the PTS forums, I looked at them and don't see any info on 1.3.3 being tested in any real way on the PTS. Whatever is being tested there doesn't seem meaningful to what's pushed to the EU/NA servers.

If it were limited time/availability to test, I think that would help, as the only time to advance those characters would be during test windows.

How much more integrated can you get?

https://dl.dropboxusercontent.com/u/81936448/PTS.JPG

http://forums.elderscrollsonline.com/categories/pts The whole forums about the PTS. There was quite a bit on update 3. But here's the problem

1. People pay to play not to test
2. If they can't re create it they can't pin point the problem and fix it
3. It's a more controlled environment. Open server has more options for breaking because it is not controlled.
4.In house testers use the same computers all the time and don't account for other peoples computers. So if the problem is with the I5 and they are using I7 they are not gonna see it.
5. Most people use the PTS not to test but to see what's coming up and how they can use it to their advantage when it goes live instead of actually testing it.
6. Squirrel
7. The PTS has also been around longer and much like a car has been broke in more than the public on
8.
Also they sometimes push more patches than what you see on the PTS