AI Audit & Security: From Reinforcement Learning to LLM Agents
This domain hosted the IJCAI 2022 tutorial on adversarial reinforcement learning. It is now an independent reference on how AI systems are evaluated, audited, and defended.
See the coverage mapLive demo: evasion attack on a malware classifier
The input is almost unchanged. The verdict flips. This is an adversarial example.
Global AI Security Architecture
From the foundational IJCAI 2022 tutorial to modern production environments, AI security is structured across four core operational pillars.
| Domain Pillar | Core Threat Vectors & Systems | Primary Entry Pages |
|---|---|---|
| 1. Generative AI & Agents | LLM Red Teaming, Direct/Indirect Prompt Injection, RAG & Vector DBs, Agent Tool Hijacking, Multimodal & Vision Security | LLM Red Teaming/llm-red-teaming/RAG & Vector DB Security/rag-vector-db-security/ |
| 2. Classical ML, RL & Graphs | Predictive ML Evasion, Reinforcement Learning, Data Poisoning & Backdoors, Graph Neural Networks (GNN), Neuro-Symbolic Worst-Case Proofs | Adversarial Attacks on RL/adversarial-attacks-reinforcement-learning/Data Poisoning & Backdoors/data-poisoning-backdoor-attacks/ |
| 3. Infrastructure & System Security | Model Supply Chain, Checkpoint Integrity, Runtime Guardrails, Data Drift Monitoring, Networked & Distributed AI Penetration Testing | AI Supply Chain Security/ai-supply-chain-security/AI Guardrails & Monitoring/ai-guardrails-monitoring/ |
| 4. Audit, Standards & Governance | Comprehensive Audit Frameworks, OWASP LLM Top 10 Mapping, MITRE ATLAS Matrix, EU AI Act Compliance & ISO/IEC 42001 | AI Audit & Security Framework/ai-audit/AI Governance & EU AI Act/ai-governance-eu-ai-act-iso-42001/ |
Three older domains lead here
Each domain worked on a part of the same question: how far can a system be trusted when someone tries to break it.
| Former domain | Original subject | Why it belongs here | Landing page |
|---|---|---|---|
| aofa2007.org | Analysis of algorithms | Worst-case analysis defines robustness: what an attacker can force, not what usually happens. | Analysis of algorithms and worst-case robustness/analysis-of-algorithms-worst-case-robustness/ |
| strategicreasoning.net | Strategic reasoning, agents, game theory | Attackers and defenders are strategic agents. Game theory models both. | Strategic reasoning and multi-agent security/strategic-reasoning-multi-agent-security/ |
| wasaconf.org | Wireless algorithms, networked systems & distributed computing | Deployed AI agents operate on networked systems where algorithmic robustness meets network security. | Networked systems & AI security audit/ai-penetration-testing-audit/ |
Every field of AI security, one page each
Fourteen pages cover attacks, audit method, defenses and frameworks.
AI Audit & Security FrameworkScope, method, evidence and report of an audit./ai-audit/LLM Red TeamingStructured attack campaigns against language models./llm-red-teaming/Prompt Injection AttacksDirect, indirect and RAG injection, with tests and fixes./prompt-injection-attacks/RAG & Vector DB SecurityVector stores, embedding poisoning, multi-tenant isolation./rag-vector-db-security/AI Agent Security AuditTool use, privileges, memory poisoning, orchestration./ai-agent-security-audit/Multimodal & Vision SecurityPhysical adversarial attacks, steganography, watermarks./multimodal-computer-vision-security/Adversarial Attacks on RLTest-time and training-time attacks on policies./adversarial-attacks-reinforcement-learning/Data Poisoning and BackdoorsCorrupted training data, trojans, sleeper behavior./data-poisoning-backdoor-attacks/Model Extraction & Privacy AttacksModel theft, membership inference, data leakage./model-extraction-privacy-attacks/AI Supply Chain SecurityDatasets, pretrained models, dependencies, checkpoints./ai-supply-chain-security/AI Guardrails and MonitoringFiltering, drift detection, runtime alerts, robust training./ai-guardrails-monitoring/OWASP LLM Top 10The ten LLM risks, mapped to audit tests./owasp-llm-top-10/MITRE ATLAS FrameworkAdversary tactics and techniques against ML systems./mitre-atlas-framework/AI Governance & EU AI ActObligations, controls and audit evidence./ai-governance-eu-ai-act-iso-42001/