At PwnzzAI Shop, every slice serves up a helping of holistic AI security instruction. This hands-on learning platform prepares professionals to understand the protection of AI technologies broadly delivered through an engaging, practical pizza shop scenario.
Just as an incorrect ingredient can spoil a pizza, a flawed prompt or inadequate architecture can leave AI technologies vulnerable to severe threats, including information breaches, intellectual property theft, or illegitimate access.
Here, you'll explore practical examples of how vulnerabilities are created, exploited, and mitigated. You need to login as alice/alice or bob/bob for some pages. Grab a slice, dig in, and discover how delicious learning about AI security can be.
Table of Content
PwnzzAI Shop represents a hands-on learning platform purposefully built for instruction on AI technology protection. This intentionally insecure Flask-based web application showcases an extensive array of AI security weaknesses via an immersive pizza shop experience.
PwnzzAI is designed as a comprehensive, evolving learning platform aligned with the AI Exchange risk taxonomy Its scope expands progressively in step with OWASP AI Exchange security analysis frameworks and defensive guidance, ensuring long-term relevance as AI security practices mature. The project currently incorporates the OWASP Top 10 for LLMs, with an architecture intentionally mapped to AI Exchange risk classifications. Over time, PwnzzAI aims to mature into a structured learning ecosystem that supports:
-
AI protection and defense training, including self-directed learning paths
-
Hands-on security training programs with practical, scenario-driven exercises
-
Team-based learning initiatives for security engineers and practitioners
-
End-to-end AI security education, spanning design, development, deployment, and operations
The easiest way to get started is using our pre-built Docker image:
-
Pull the Docker image:
docker pull ghcr.io/maryammouzarani2024/pwnzzai:latest
-
Run the container:
docker run -p 5000:5000 ghcr.io/maryammouzarani2024/pwnzzai:latest
-
Visit
http://localhost:5000in your browser to see the application. Start from the Basic page and setup your lab.
The image already includes Ollama so you only need to pull the required models as described in the lab setup section of the Basics page.
-
Create a virtual environment (optional but recommended):
python -m venv venv source venv/bin/activate # On Windows: venv\Scripts\activate
-
Install the dependencies:
(If you do not want to use Ollam, you can remove or comment the line "curl -fsSL https://ollama.com/install.sh | sh" from install.sh)
./install.sh
-
Run the application:
flask run
-
Visit
http://localhost:5000in your browser to see the application. Start from the Basic page and setup your lab.
If you need more details, watch this walkthrough , that shows, step-by-step, how to set up the app using either options.
- Pizza Service: Browse appetizing pizzas, explore customer feedback, contribute comments, and place virtual orders!
- Extensive Weakness Showcases: Active demonstrations spanning OWASP LLM Top 10 and AI Exchange threat categories including model input threats, development-time threats, runtime security threats, and system-level AI risks.
- Learning-Focused Design: Discover exploitation methods and defensive approaches via transparent descriptions, crafted for organized instruction programs and aligned with AI Exchange threat taxonomy.
- Multi-Provider Implementation: Every demonstration operates with both commercial OpenAI and complimentary free Ollama frameworks, ensuring accessibility for all participants.
- Standards-Based Content: Educational materials synchronized with OWASP AI Exchange, which serves as the foundational basis for emerging AI security standards such as ISO/IEC 27090 and prEN 18282.
This platform showcases an extensive spectrum of AI protection challenges, aligned with the OWASP AI Exchange comprehensive threat taxonomy. Current implementation covers the OWASP Top 10 for LLM Applications and core AI Exchange threat categories, with an extensible architecture built for future AI risk coverage.
Every weakness demonstrated in PwnzzAI features:
- Active demonstrations illustrating the vulnerability's mechanics
- Exploitation scenarios providing interactive attack exercises
- Hardened alternatives detailing defensive approaches
According to OWASP Top 10 for LLM Applications 2025 and OWASP AI Exchange threats:
-
LLM01: Prompt Injection (AI Exchange: Direct Prompt Injection, Indirect Prompt Injection)
- Direct Prompt Injection: Bypass system instructions through crafted user inputs to manipulate model behavior.
- Indirect Prompt Injection: Exploit external data sources to inject malicious instructions and manipulate model responses.
- AI Exchange Context: Model input threats where attackers craft instructions to deceive the model.
-
LLM02: Sensitive Information Disclosure (AI Exchange: Data Disclosure, Training Data Leaks)
- Extraction of training data, system information, and credentials through model outputs.
- AI Exchange Context: Training data confidentiality threats including model inversion, membership inference, and sensitive data output from model.
- LLM03: Supply Chain Vulnerabilities (AI Exchange: Supply Chain Model Poisoning)
- Third-party model and plugin security risks from compromised suppliers.
- AI Exchange Context: Development-time supply chain threats including poisoned pre-trained models, corrupted data sources, and compromised model hosting.
-
LLM04: Data and Model Poisoning (AI Exchange: Data Poisoning, Model Poisoning)
- Demonstrate how malicious training data affects model responses and behavior.
- AI Exchange Context: Development-time threats where training data manipulation or direct model parameter tampering leads to unwanted model behavior.
-
LLM05: Improper Output Handling (AI Exchange: Insecure Output)
- Unvalidated LLM outputs leading to XSS and other injection attacks in downstream systems.
- AI Exchange Context: Runtime application security threats where model output contains malicious code or injection attacks.
-
LLM06: Excessive Agency (AI Exchange: Least Model Privilege, Oversight)
- Over-privileged LLM operations and autonomous actions without appropriate constraints.
- AI Exchange Context: Impact limitation controls to restrict unwanted model behavior through privilege management and human oversight, particularly critical for agentic AI systems.
-
LLM07: System Prompt Leakage (AI Exchange: Sensitive Information Disclosure)
- Extraction of secret information embedded in system prompts through manipulation techniques.
- AI Exchange Context: Model use threats where attackers extract confidential instructions or configuration data through crafted inputs.
-
LLM08: Vector and Embedding Weakness (AI Exchange: Data Confidentiality)
- Unauthorized access to embeddings containing sensitive information in RAG systems or vector databases.
- AI Exchange Context: Augmentation data threats where retrieval repositories or embedding stores leak confidential information.
-
LLM09: Misinformation (AI Exchange: Model Alignment, Continuous Validation)
- Critical decision-making without human oversight leading to harmful misinformation or hallucinations.
- AI Exchange Context: Unwanted model behavior risks requiring oversight controls, explainability, and continuous monitoring to ensure accuracy and safety.
-
LLM10: Unbounded Consumption (AI Exchange: AI Resource Exhaustion)
- Resource exhaustion attacks and rate limiting bypass techniques causing denial of service.
- AI Exchange Context: Model availability threats through resource depletion via excessive or crafted inputs.
and,
- Model Theft (in earlier OWASP Top 10 for LLM versions) (AI Exchange: Model Theft Through Use, Runtime Model Theft)
- Model extraction and intellectual property theft through API abuse and input-output harvesting.
- AI Exchange Context: Model confidentiality threats including model parameter extraction, model replication, and intellectual property theft through various attack vectors.
- OpenAI Models: GPT-3.5/GPT-4 demonstrations via OpenAI API.
- Ollama Models: Free models, such as Mistral 7B and LLaMA 3.2 1B, are accessible through Ollama.
