Lessons Learned from Building & Defending LLM Applications
Practical insights and defensive strategies from real-world development and hardening of production LLM applications.
Summary
Challenges in Securing LLM Applications
Deploying large language models into production introduces new vulnerability classes alongside traditional application security challenges. Securing AI applications requires moving beyond theoretical threat models to address real-world operational edge cases.
Vulnerability Patterns and Defense Strategies
Critical risks in LLM architectures include untrusted context injection, unauthorized tool execution, and insecure data retrieval pipelines. Implementing defensive guardrails, rigorous input validation, and output filtering strengthens application robustness against adversarial exploitation.
Related talks
Briefings·26 min
Jiashuo Liang · Guancheng Li
Introduces a novel gradient-based prompt-injection technique that can generate universal triggers to manipulate open-source Large Language Model (LLM) outputs.
App Sec Village·18 min
Wang Zhilong · Xinzhi Luo
Analysis of when and why large language models hallucinate during automated code review, and how misleading identifier names induce errors.
CyberRisk TV·16 min
Ramin Farassat
Ramin Farassat investigates How Menlo Security Is Securing AI Agents from Prompt Injection.


