TripleA Server Costs
-
The bots just mass-restarted a few minutes ago.
The good news is that now they are all 15 up and running.
However, I'm under the understanding that everyone who was in a bot at the moment of the mass-restart was disconnected and unable to save its game. If so, that is rather brutal a way to have the bots all back...
I don't actually know for certain what happened: I never play in bots and was not in a bot when that happened. I just saw all bots disappear together in lobby list and then come back all together with also those missing. This is what was going on in lobby right after that happened:
-
Do you know what triggered the mass restart ? That's not good with everyone getting disconnected.
It's actually really bad.
@lafayette you probably want to check this out
-
The lobby restarted. No bots should have. I'm checking in whether there were some one-offs. In general, nobody should have been disconnected from a bot game and we need to be 1000% clear whether a player was simply disconnected from lobby or the bot game. "I was disconnected" could mean the lobby, and that would be expected.
No autosaves should have been lost either.
Also, why are we talking about lobby issues in a "TripleA Server Costs" thread?
edit: updated "no bots did" to "no bots should have"
-
was just replying to Cernels screenshot
-
-
There were server changes, they apply wholesale and part of that are server package upgrades. 'Docker' which runs the bots was part of that and was restarted. No autosaves should have been lost though, except no autosaves are expected to be cut at the time of the restart either.
So, this event is fairly rare, there was a misconfig that looped the bots into the blast radius, and the autosaves would have been slightly dated (ie: beginning of round rather than at moment of restart).
There's 3 fixes that can be applied here:
- don't restart docker, that can be added to a blacklist for restart-on-package-upgrade
- decouple the docker containers from the docker service, we can add a config that detaches the containers and bounces the service, and then re-attaches them (by default the containers are taken down and then rebooted)
- add a shutdown hook to the game code for bots, to capture an autosave when the game shuts down.
-
@beelee As I said, I don't know what actually happened. I was not in a bot. Just in lobby seeing all bots disappear and reappear and the talking in lobby which I mostly showed here with the screenshot I posted. Maybe @eyeswideshut knows more about this. (The best would be that somebody who was playing in a bot at the moment comes here and tells us what he/she experienced: if he/she lost part of its game and how much of it was save if it was, but that is very unlikely to happen.)
To be clear, I'm not saying that was all negative: there were 10 out of 15 bots in the lobby and a few users were unable to play games for lacking available bots, so this restart actually fixed all bots, a third of which were broken, and brought all them back fresh and available.
Personally, I was thinking to suggest a count-down starting 1 minute before this event, with the bot itself telling that it will restart itself in 1 minute and inviting everyone inside to save the game or letting the shut-down games remaining open on the user's side as dead games which however allow taking a save. However, I've seen that @lafayette proposed a bunch of solution which are likely better and make my suggestions unnecessary (but I don't fully understand them).
-
No autosaves should have been lost though, except no autosaves are expected to be cut at the time of the restart either.
In the last screenshot I posted, @eyeswideshut said "cernel my understanding is that autosave was removed from triplea".
I don't know if autosaves work: I've never playtested any bots since the release.
-
This post is deleted! -
L LaFayette referenced this topic
-
@cernel / @beelee moving this convo to: https://forums.triplea-game.org/topic/4421/bot-crash-2026-09-20, and locking this thread.
-
L LaFayette locked this topic
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login