Xbox Chief Tech Officer Explains Server Outage and What’s Coming Next
Yesterday, Xbox gamers were surprised to see that not only were they unable to play multiplayer, but even some of their single-player games that required an online connection failed to run.
The Xbox Live (network?) services were down for a significant amount of time, only to be resolved completely at nighttime.
Needless to say, gamers were upset, and while Xbox Support provided updates from time to time, this wasn’t enough.
This is where Scott Van Vliet, Xbox CTO, stepped in and provided an explanation of what happened.
Prolonged Xbox Outage Was Due to One Single Point of Failure
On X (formerly Twitter), Van Vliet provided a lengthy explanation of what happened and what steps they’re taking next.
What happened. Late last night, a licensing service that sits outside of XBOX, but which XBOX depends upon, began failing. This caused some sign-in scenarios to fail, and it caused many scenarios that require an entitlement check to also fail, such as listing out your Full Library and launching games that you own. It also affected several of our publishing and store partners who depend on those same systems which is why some of you saw issues in specific games and not others.
What we did. Our on-call teams caught the first signals overnight through automated monitoring and declared a major incident. Once we isolated the failing infrastructure, we shifted traffic onto the healthy parts of the system while the team continued to work towards a root cause. Service came back unevenly across regions which is why some of you recovered hours before others.
What’s next. We’re running a full post-incident review. I care less about the one-line root cause and more about the real questions: why a failure in one service was able to take down this much, why recovery took as long as it did, and what we change so a single point of failure can’t ruin your night again. That means hardening the dependencies underneath sign in and game launch, improving how we detect and contain this class of failure, and being faster and clearer with you when something breaks.
This explanation is a small gesture, though the transparency is much appreciated. Let’s hope Microsoft continues to improve the Xbox infrastructure, so we won’t experience these sorts of failures due to a single line.
In related news, there is an upcoming system update for Xbox, and it’ll improve game download speeds. Another feature we’re expecting to see soon is the disc-to-digital conversion that Xbox is testing with select members.
Stay connected to MP1st and the latest news by following us on Bluesky, X, Facebook, TikTok, YouTube, and Google News.
