Skip to content

DEF CON 34 talks are here: 354 talks, summarized and searchable.

Browse DEF CON 34

RAG Against the Machine: Using Retrieval-Augmented Generation & MCP to Fortify Cybersecurity Defense

Brennan Lodge

AI SecurityGround Truth51 minIntermediateOpen on YouTube ↗

Where

Ground Truth
BSides Las Vegas

Duration

51 min

Shows how retrieval-augmented generation and MCP can feed threat intel and logs into LLMs for SOC triage and compliance mapping.

Summary

The talk opens with the pressures on security operations: alert volume, false positives, staffing gaps and burnout. The speaker argues AI should act as an assistant with a human still in the loop, and that internal data can stay private if retrieval runs in a self-hosted environment rather than a hosted service.

The core of the talk is retrieval-augmented generation, explained through a library analogy. An embedding model turns a question into searchable terms, a vector database holds chunked documents such as ATT&CK techniques, Sigma detections and advisories, and a language model writes the answer from the retrieved passages. Refreshing the index keeps answers current, unlike a static model. Guardrails covered include encrypting the store, filtering inputs and outputs, and logging activity to the SOC, and he noted that judging answer quality is hard.

Demos show an open-source tool that uses Model Context Protocol to connect the model to these sources, mapping a Splunk detection to a MITRE technique and linking related threat intel. A second tool classifies uploaded policies with a BERT-based model to estimate coverage against frameworks such as SOC 2. He closes by urging practitioners to start small, test with their own data and press vendors on cost and token transparency. In Q&A he suggested running open-source models locally to cut costs.

Related talks

Ground Truth·55 min

Joshua D Saxe · Younghoo Lee

Shows how large language models like GPT-3 can describe command lines and detect spam from only a few examples.

aimachine-learningdetection+1

Ground Truth·8 hr 46 min

Collects several Ground Truth talks on AI-driven scams, vulnerability prioritization, prompt security and agent hacking.

aiphishingmachine-learning+2