Skip to content

Topic

Cloud Outages

Topic covering large-scale failures of cloud-hosted services, from faults and maintenance errors to physical attacks, and the reports that document them.

Current stories

buildOne report1 publisher

A 5h55m Azure OpenAI outage in Sweden Central needs a circuit breaker and a second route

Azure OpenAI and Foundry in Sweden Central failed for 5 hours 55 minutes on 29 September, according to a postmortem write-up summarised on dev.to. The post prescribes a per-call timeout, a circuit breaker and a second route, and we found two gaps in its sample breaker.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap−5
Incentives
Not scored
Confidence50
investConfirmed22 publishers

Yandex loses its 50MW Vladimir data centre to the third drone strike in four days

Yandex shut its Vladimir data centre after a drone attack, the third of its sites knocked out within days. Cloud customers absorbed outages across more than 80 services, cryptobriefing reported, and the only share-price reading, a fall of nearly 4%, came after the second strike.

Perspective Coverage

26 publishers
Builder
Builder 18%
Operator
Operator 63%
Investor
Investor 19%

Reality

Evidence76
Adoption
Not scored
Hype gap+15
Incentives55
Confidence72
buildConfirmed4 publishers

Yandex-network bot traffic falls to 0.4% of its two-week peak after Ukrainian drone strikes

Cloudflare reports Yandex-network bot traffic fell to 0.4% of its two-week peak after Ukrainian drone strikes on Yandex data centers. The series covers one network's requests, so it documents a provider outage more firmly than any change in global traffic.

Perspective Coverage

5 publishers
Builder
Builder 25%
Operator
Operator 52%
Investor
Investor 23%

Reality

Evidence58
Adoption
Not scored
Hype gap+55
Incentives
Not scored
Confidence70
buildOne report1 publisher

Fiber maintenance between us-west1 campuses cascaded into Spanner Paxos and the metadata server

Google's final report on the August 20 incident traces more than two dozen degraded products back to lost capacity on the links between data centers inside us-west1, after automated rerouting failed to move the traffic.

Publishers:dev.to

Reality

Evidence58
Adoption38
Hype gap+15
Incentives70
Confidence55
buildOne report1 publisher

An unsequenced work order defeated Google's redundant routers in 13 minutes

Google's report on the 1 September us-central1 outage describes a 4-hour-11-minute failure that started when higher-density transceivers met fabric ends still running the old optics. Technicians fixed it by putting the original parts back.

Publishers:status.cloud.google.com

Reality

Evidence66
Adoption55
Hype gap+14
Incentives78
Confidence64
productOne report1 publisher

Outlook's Monday outage left one user unable to receive verification emails, others reporting varied issues

Microsoft traced the failure to recent changes it had made to the service and spent the day testing whether reverting them would help. For anyone mapping dependencies, it was a cheap rehearsal.

Publishers:cnet.com

Reality

Evidence45
Adoption40
Hype gap−15
Incentives70
Confidence55