Back to selected work

PROJECT BRIEF / 02

Make AI safety testable

PyRIT red-team demo

Demo2026Public repository
  • PyRIT
  • Model safety
  • Evaluation

The context

AI safety becomes more useful to customer teams when it can be inspected, discussed, and tested. This demo makes risk identification visible through several hands-on interfaces.

The approach

  • Offer notebook-based exploration of model safety testing.
  • Generate a static report to make evaluation results reviewable.
  • Use a live dashboard to explore supported model and multimodal scenarios.
  • Keep the underlying PyRIT framework and Azure model prerequisites explicit.

The leadership connection

A practical approach to responsible AI enablement: make the testing process understandable and give teams evidence to review.

What to look at

Choose an interface

Start with the notebook, report generator, or live dashboard.

Inspect the evaluation

Review scoring and test limitations, not just a blocked or bypassed label.

Use with authorization

Test only models and environments you are authorized to assess.

Continue exploring

The lifecycle after training

Next project: Azure ML + MLflow workshop