CDAO Sponsors Crowdsourced AI Assurance Pilot in the Context of Military Medicine

The DoD CDAO announced results of a CAIRT pilot in which Humane Intelligence led a crowdsourced red-teaming exercise of three LLM chatbots for military medicine use cases (clinical note summarization and a medical advisory chatbot), engaging 200+ participants and surfacing 800+ potential vulnerabilities and biases. The effort will produce benchmark datasets to evaluate future tools and guide DoD policies and risk management for responsible GenAI adoption, supporting improved mission effectiveness and assurance across defense healthcare applications.