SkillAgentSearch skills...

LLMSecurityGuide

A comprehensive reference for securing Large Language Models (LLMs). Covers OWASP GenAI Top-10 risks, prompt injection, adversarial attacks, real-world incidents, and practical defenses. Includes catalogs of red-teaming tools, guardrails, and mitigation strategies to help developers, researchers, and security teams deploy AI responsibly.

Install / Use

/learn @requie/LLMSecurityGuide

README

🛡️ LLM Security 101: The Complete Guide (2026 Edition)

<div align="center">

LLM Security Agentic AI OWASP 2025 License Contributions Updated

A comprehensive guide to offensive and defensive security for Large Language Models and Agentic AI Systems, updated for February 2026 with the OWASP Top 10 for LLMs 2025, corrected OWASP Top 10 for Agentic Applications 2026 (ASI prefix), new security tools, recent incidents, and AI regulation coverage.

OverviewWhat's NewQuick StartOWASP LLM 2025🆕 OWASP Agentic 2026ToolsResources

</div>

🚨 BREAKING UPDATE - February 2026

MAJOR UPDATE: This guide has been significantly updated with critical corrections and new content for 2026. The OWASP Agentic Top 10 identifiers have been corrected from the unofficial "AAI" prefix to the official "ASI" (Agentic Security Issue) prefix with proper ordering per the December 2025 release. New sections cover DeepSeek R1 security concerns, recent AI security incidents, emerging red teaming tools, and AI regulations.

🆕 What's New in This Update

| Addition | Description | |----------|-------------| | 🔴 ASI Prefix Correction | Fixed OWASP Agentic Top 10 from incorrect AAI to official ASI identifiers with correct ordering | | 🆕 New Security Tools | DeepTeam, Promptfoo, ARTKIT, Meta LlamaFirewall/Llama Guard 4 | | 🆕 New Case Studies | EchoLeak (CVE-2025-32711), DeepSeek R1 vulnerabilities, first malicious MCP server | | 🆕 AI Regulations | EU AI Act 2026 milestones, NIST AI RMF, ISO/IEC 42001 | | 🔄 Updated LLM Ecosystem | GPT-5.x, Claude Opus 4.6, Gemini 3.x, Llama 4 models | | 📈 Updated Resources | New research references, red teaming tools, and regulatory resources |

This guide covers the OWASP Top 10 for LLM Applications 2025 (released November 18, 2024) and the OWASP Top 10 for Agentic Applications 2026 (released December 10, 2025). Key topics include Agentic AI Security, RAG Vulnerabilities, System Prompt Leakage, Vector/Embedding Weaknesses, and AI Compliance.


📋 Table of Contents


🎯 Overview

As Large Language Models become the backbone of enterprise applications, from customer service chatbots to code generation assistants, the security implications have evolved dramatically. This guide provides a comprehensive resource for:

  • 🔐 Security Researchers exploring cutting-edge LLM vulnerabilities
  • 🐛 Bug Bounty Hunters targeting AI-specific attack vectors
  • 🛠️ Penetration Testers incorporating AI security into assessments
  • 👨‍💻 Developers building secure LLM applications
  • 🏢 Organizations implementing comprehensive AI governance
  • 🎓 Students & Academics learning AI security fundamentals

Why This Guide Matters

  • Current & Comprehensive: Reflects 2025 LLM OWASP standards AND the new 2026 Agentic standards
  • Practical Focus: Real-world tools, techniques, and implementations
  • Industry Validated: Based on research from 500+ global experts
  • Enterprise Ready: Production deployment considerations and compliance
  • Community Driven: Open-source collaboration and continuous updates

🆕 What's New in 2025/2026

OWASP Top 10 for LLMs 2025 Major Updates

The November 2024 release introduced significant changes reflecting real-world AI deployment patterns:

🆕 New Critical Risks

  • LLM07:2025 System Prompt Leakage - Exposure of sensitive system prompts and configurations
  • LLM08:2025 Vector and Embedding Weaknesses - RAG-specific vulnerabilities and data leakage
  • LLM09:2025 Misinformation - Enhanced focus on hallucination and overreliance risks

🔄 Expanded Threats

  • LLM06:2025 Excessive Agency - Critical expansion for autonomous AI agents
  • LLM10:2025 Unbounded Consumption - Resource management and operational cost attacks

📈 Emerging Attack Vectors

  • Multimodal Injection - Image-embedded prompt attacks
  • Payload Splitting - Distributed malicious prompt techniques
  • Agentic Manipulation - Autonomous AI system exploitation

🆕 OWASP Top 10 for Agentic Applications 2026 (December 2025)

Released at Black Hat Europe on December 10, 2025, this globally peer-reviewed framework identifies critical security risks facing autonomous AI systems:

| Rank | Vulnerability | Description | |------|--------------|-------------| | ASI01 | Agent Goal Hijack | Redirecting agent objectives via prompt injection, deceptive tool outputs, or poisoned data | | ASI02 | Tool Misuse & Exploitation | Agents misusing legitimate tools due to prompt injection, misalignment, or unsafe delegation | | ASI03 | Identity & Privilege Abuse | Exploiting inherited/cached credentials, delegated permissions, or agent-to-agent trust | | ASI04 | Agentic Supply Chain Vulnerabilities | Malicious or tampered tools, descriptors, models, or agent personas | | ASI05 | Unexpected Code Execution | Agents generating or executing attacker-controlled code | | ASI06 | Memory & Context Poisoning | Persistent corruption of agent memory, RAG stores, or contextual knowledge | | ASI07 | Insecure Inter-Agent Communication | Spoofed inter-agent messages misdirecting entire clusters | | ASI08 | Cascading Failures | False signals cascading through automated pipelines with escalating impact | | ASI09 | Human-Agent Trust Exploitation | Confident, polished explanations misleading human operators into approving harmful actions | | ASI10 | Rogue Agents | Compromised or misaligned agents diverging from intended behavior |

The framework introduces the principle of "least agency" — only granting agents the minimum autonomy required for safe, bounded tasks.

New Security Technologies

Latest Security Tools (2024-2026)

  • WildGuard - Comprehensive safety and jailbreak detection
  • AEGIS 2.0 - Advanced AI safety dataset and taxonomy
  • BingoGuard - Multi-level content moderation system
  • PolyGuard - Multilingual safety across 17 languages
  • OmniGuard - Cross-modal AI safety protection

🆕 Red Teaming & Offensive Tools (2025-2026)

  • DeepTeam - Open-source LLM red teaming framework by Confident AI with 40+ vulnerability types and 10+ adversarial attack methods, supporting OWASP Top 10 and NIST AI RMF
  • Promptfoo - Open-source prompt injection, jailbreak, and data leak testing (30,000+ developers, CI/CD integration)
  • ARTKIT - Open-source framework for automated multi-turn adversarial prompt generation and attacker-target interactions
  • Meta LlamaFirewall - Open-source protection framework released with Llama 4, including Llama Guard 4 and Llama Prompt Guard 2

Enhanced Frameworks

  • Amazon Bedrock Guardrails - Enterprise-grade contextual grounding
  • Langfuse Security Integration - Real-time monitoring and tracing
  • Advanced RAG Security - Vector database protection mechanisms

🤖 Understanding LLMs

What is a Large Language Model?

Large Language Models (LLMs) are advanced AI systems trained on vast datasets to understand and generate human-like text. Modern LLMs power:

  • 💬 Conversational AI - ChatGPT, Claude, Gemini
  • 🔧 Code Generation - GitHub Copilot, CodeT5
  • 📊 Business Intelligence - Automated reporting and analysis
  • 🎯 Content Creation - Marketing, documentation, creative writing
  • 🤖 Autonomous Agents - Task automation and decision making

Current LLM Ecosystem

| Category | Examples | Key Characteristics | |--------------|--------------|------------------------| | Foundation Models | GPT-5.x, Claude Opus 4.6, Llama 4 | General-purpose, up to 1M+ token context windows | | Specialized Models | Codex, Med-PaLM 2, FinGPT | Domain-specific optimization | | Multimodal Models | GPT-5, Claude Opus 4.6, Gemini 3.x | Text, image, audio, video processing | | Agentic Systems | Claude Code, OpenAI Codex agent, LangChain Agents | Autonomous multi-step task execution | | RAG Systems | Enterprise search, Q&A bots | External knowledge integration |

🆕 What is Agentic AI?

Agentic AI represents an advancement in autonomous systems where AI operates with agency—planning, reasoning, using tools, and executing multi-step actions with minimal human intervention. Unlike traditional LLM applications that respond to single prompts, agentic systems:

  • **Plan

Related Skills

View on GitHub
GitHub Stars50
CategoryOperations
Updated11h ago
Forks6

Security Score

85/100

Audited on Mar 20, 2026

No findings