Cloudflare incident on November 14, 2024, resulting in lost logs

Cloudflare reported an internal logging pipeline incident on November 14, 2024, in which a misgenerated blank Logfwdr configuration triggered a fail-open path that sent logs for all customers, overwhelming the Buftee buffer service (about 40× more buffers), rendering it unresponsive and requiring a full restart; this caused roughly 55% of Cloudflare Logs to be lost/not delivered over ~3.5 hours. The company reverted the change quickly, fixed the configuration bug, and is adding alerts and regular overload testing to prevent recurrence.