Cloudflare incident on November 14, 2024, resulting in lost logs

**Cloudflare** reported a November 14, 2024 incident where a misconfiguration triggered a fail-open in Logfwdr, massively increasing buffers in Buftee (up to ~40 million) and causing a cascading overload that led to the loss of about 55% of customer logs over roughly 3.5 hours. The team reverted the bad change within five minutes but required full resets to recover due to unconfigured safeguards; planned remediations include fixing the triggering bug, adding alerts, and instituting regular overload testing to ensure systems fail gracefully.