RAG Against the Machine: Using Retrieval-Augmented Generation & MCP to Fortify Cybersecurity Defense
Where
Ground Truth
BSides Las Vegas
Duration
51 min
Shows how retrieval-augmented generation and MCP can feed threat intel and logs into LLMs for SOC triage and compliance mapping.
Summary
The talk opens with the pressures on security operations: alert volume, false positives, staffing gaps and burnout. The speaker argues AI should act as an assistant with a human still in the loop, and that internal data can stay private if retrieval runs in a self-hosted environment rather than a hosted service.
The core of the talk is retrieval-augmented generation, explained through a library analogy. An embedding model turns a question into searchable terms, a vector database holds chunked documents such as ATT&CK techniques, Sigma detections and advisories, and a language model writes the answer from the retrieved passages. Refreshing the index keeps answers current, unlike a static model. Guardrails covered include encrypting the store, filtering inputs and outputs, and logging activity to the SOC, and he noted that judging answer quality is hard.
Demos show an open-source tool that uses Model Context Protocol to connect the model to these sources, mapping a Splunk detection to a MITRE technique and linking related threat intel. A second tool classifies uploaded policies with a BERT-based model to estimate coverage against frameworks such as SOC 2. He closes by urging practitioners to start small, test with their own data and press vendors on cost and token transparency. In Q&A he suggested running open-source models locally to cut costs.
Related talks
Ground Truth·55 min
Joshua D Saxe · Younghoo Lee
Shows how large language models like GPT-3 can describe command lines and detect spam from only a few examples.
Ground Truth·55 min
Sven Cattell
Argues that adversarial robustness is a poor fit for security, and lays out the defenses that matter for ML systems.
Ground Truth·8 hr 46 min
Collects several Ground Truth talks on AI-driven scams, vulnerability prioritization, prompt security and agent hacking.


