Cisco used AI to write security incident reports, with mixed results

Cisco Talos evaluated using large language models to draft tabletop incident response reports and found substantial time savings but also significant risks — including hallucinations, cross-contamination of content between reports, inconsistent grammar checks, and poor or irrelevant recommendations — leading them to recommend isolating sessions, re-entering prompts per incident, and ensuring human ownership of all final report content.