logo

Pitting AI Against AI: Using PyRIT to Assess Large Language Models (LLMs) 

ID: 8325b884-cc8f-5ba7-b4b9-eb291f1bcd4c

STIX ID: report--8325b884-cc8f-5ba7-b4b9-eb291f1bcd4c

Feed Name: Black Hills Infosec Blog

Date Published: 2024-12-19

Date Updated: 2026-04-27

Author: BHIS

...
...

- This blog post introduces and demonstrates Microsoft’s PyRIT framework for automating red-teaming tasks against large language models. It provides step-by-step installation and setup on Ubuntu 24.04, shows where to find example code, details obtaining Crucible and OpenAI API keys, and walks through using PyRIT in JupyterLab to run an OpenAI-driven attack against the Crucible “Bear 4” challenge, including code snippets and the resulting transcript showing a successful flag retrieval.

Your team is not currently subscribed to this feed. You must subscribe to it in order to see this post.