Back

Microsoft Reveals That An Old Bug Caused The Massive Outage That Took Its Services Offline
SiTech AI Team2 min read

Microsoft Reveals That An Old Bug Caused The Massive Outage That Took Its Services Offline

Microsoft said three root causes, including a latent bug dating to July, led to an outage that took Outlook, Teams and Copilot 365 offline for businesses, hospitals and other organizations worldwide, and promised a final report this week.

Microsoft has revealed more details about the outage that took services such as Outlook, Teams and Copilot 365 offline, affecting businesses, hospitals, law enforcement and other organizations worldwide. Charles Lamanna, the company's executive vice president for Copilot and AI Agents, said on X that three root causes led to the incident.

Three root causes

Lamanna said Microsoft typically maintains two network gateway systems that connect separate systems and allow data to pass between them. During the outage, one gateway was not working for Microsoft Teams and overwhelmed the primary gateway. Nearly 14 percent of the capacity for that gateway was out of service because of an unrelated issue from the previous day. Those two factors caused the gateway to encounter a latent bug that has been in Microsoft's systems since July. Together, the higher load, reduced server capacity and latent bug led to a buildup in traffic requests until Microsoft's servers gave out and stopped functioning.

Timeline and recovery

The outage happened on a Thursday afternoon during peak hours of use in the United States and lasted almost a full day. Microsoft worked on fixing the issue overnight, but the bug was months old and the company was unable to simply do a rollback to quickly undo the changes it had caused. After returning to service, its servers were overwhelmed by waiting traffic and became unresponsive again.

Apology and final report

"We are deeply sorry for the impact to all our customers and recognize the impact that this has on their normal business and operations," Lamanna wrote. Microsoft said it will release more details in the final report later this week.

SiTech.ge covered the incident as it unfolded: the November 12 outage stretched past 12 hours while fixes kept failing.

Sources: Engadget

SiTech

SiTech — AI-powered web development

We build fast, modern websites and bring AI into real business workflows. Have a project or a question? We'd love to help.