Lobby upgrade to v18.104.22.168.6520; 2017-Sep-8
Fast on the heels of 5802, we have a new version of the lobby ready to be deployed.
We dropped the DB briding code altogether, users will need to recreate their lobby accounts once again. The bridging code we tried blew up in the v5802 upgrade attempt:
We tested the things that blew up in 5802 and things look okay with the simplified code: https://github.com/triplea-game/triplea/pull/2343
So we are now ready to upgrade the lobby to 6520. The lobby deployment is scripted and should take 5 minutes. We've a server plan change we would like to do as well to get us to a cheaper plan per month (no performance loss, just going from a 2048 plan to a 1048 plan that will save us $5/month).
The biggest impact of upgrading to 6520 will be stopping bots and having players pause and save their games.
Schedule/Steps in the deployment:
- T-15 minutes: notify lobby players
- T-10: close any empty bot servers
- T-5: verify bot games are saved
- T-3: stop all bot games
- T-2: verify no active hosted games
- T-1: final lobby check
- stop lobby
- linode resize server to 1024
- T+5: boot server
- T+6: log in, stop lobby, install 6520
- T+9: start lobby
- T+10: check lobby
- T+15: go/no-go call #1, notify forum lobby is available
- T+15: start bots
- T+25: bots should be connected, verify bots
- T+30: final go/no-go call, notify completion
started! lobby is stopped
Server resize is under way to 1024 plan, 51%
done, booting server, software upgrade next.
software upgrade is done, checking connectivity, not logging in right away : / SNAFU..
@lafayette Is SNAFU French for perfect?
Oh but of course : )
We're seeing some really slow logins, order minutes. On a retry I was able to login in pretty quickly.
Account creation and password login works now, while it did not with 5802. Login performance is currently the only known area for concern
Looking at the server, it's pretty taxed, no memory left. THat is probably teh slow login problem. I'm going to take the lobby down once more and upgrade to the next largest plan to give more memory. We were just on the 2048 plan, had little issue, will go back to that.
If you logged in to the lobby int he last 15 minutes and created an account, there is no need to create a new one. Otherwise you'll need to create a new lobby account as we are using a new database.
The lobby plan upgrade to 2048 is started! 40% done
Server now booting!
Lobby is running again, you can log back in!
(maybe, looks like login is still slow...)
bots are starting.
looks like things are okay. Tracking slow lobby login here: https://github.com/triplea-game/triplea/issues/2344
Hopefully we'll get that figured out sooner..
I am experiencing some problems with my newly created account: