DO it again: how we used Durable Objects to add WebSockets support and authentication to AI Gateway

Cloudflare announced a new WebSockets API for AI Gateway that provides a single, persistent, authenticated connection to AI providers, leveraging Durable Objects to handle scale, session-level settings, and concurrent streaming with request correlation via an eventId. The post details authentication options (API token via header or WebSocket subprotocol), message envelopes for non-streaming and streaming responses, and example client implementations for Node.js and browsers. The capability is in open beta now, with planned support for direct WebSocket-to-WebSocket connections to provider real-time APIs in Q1 2025.