Course Outline
Introduction to AI Threat Modelling
- What makes AI systems vulnerable?
- AI attack surface vs traditional systems
- Key attack vectors: data, model, output, and interface layers
Adversarial Attacks on AI Models
- Understanding adversarial examples and perturbation techniques
- White-box vs black-box attacks
- FGSM, PGD, and DeepFool methods
- Visualising and crafting adversarial samples
Model Inversion and Privacy Leakage
- Inferring training data from model output
- Membership inference attacks
- Privacy risks in classification and generative models
Data Poisoning and Backdoor Injections
- How poisoned data influences model behaviour
- Trigger-based backdoors and Trojan attacks
- Detection and sanitisation strategies
Robustness and Defence Techniques
- Adversarial training and data augmentation
- Gradient masking and input preprocessing
- Model smoothing and regularisation techniques
Privacy-Preserving AI Defences
- Introduction to differential privacy
- Noise injection and privacy budgets
- Federated learning and secure aggregation
AI Security in Practice
- Threat-aware model evaluation and deployment
- Using ART (Adversarial Robustness Toolbox) in applied settings
- Industry case studies: real-world breaches and mitigations
Summary and Next Steps
Requirements
- An understanding of machine learning workflows and model training
- Experience with Python and common ML frameworks such as PyTorch or TensorFlow
- Familiarity with basic security or threat modelling concepts is helpful
Audience
- Machine learning engineers
- Cybersecurity analysts
- AI researchers and model validation teams
Testimonials (2)
I really enjoyed learning about AI attacks and the tools out there to begin practicing and actively using for security testing. I took a lot of knowledge away which I didn't have at the beginning and the course met what I hoped it would be. My favorite part shown from the training was Comet Browser and was amazed at what it could do. Definitely something will be looking into more. Overall it was a great course and enjoyed learning all OWASP GenAI Top 10.
Patrick Collins - Optum
Course - OWASP GenAI Security
The profesional knolage and the way how he presented it before us
