From Prompt to Protection: A Practical Guide to Building and Securing Generative AI Applications

From Prompt to Protection: A Practical Guide to Building and Securing Generative AI Applications

Level of Instruction: Intermediate

Instructed by: Ashwin Iyer, Ritika Verma

Abstract:

This hands-on workshop explores the offensive and defensive security challenges of Generative AI (GenAI). In the first half, participants will use structured frameworks and rapid threat prototyping to map out real-world GenAI risks such as - prompt injection, data poisoning, and model leakage. Working in teams, you'll threat model a GenAI system using simplified STRIDE and Rapid threat prototyping techniques and visual diagrams.

The second half flips the script: you'll build lightweight security tools that harness GenAI for good crafting utilities. No prior AI experience is required; everything is explained as we go.

This workshop is ideal for red teamers, security engineers, and curious builders. Just bring basic Python familiarity and a laptop - we’ll supply the rest.

You’ll walk away with real-world threat models, working tool prototypes, and a clear framework for breaking and securing AI systems in your org.