Summiting the Pyramid of Pain
Where
Talks
ShmooCon 2024
Duration
46 min
Presents a scoring model that rates how resistant detection analytics are to adversary changes.
Summary
The talk starts from the Pyramid of Pain, which ranks indicators from easy-to-change hashes and IP addresses up to the tactics, techniques and procedures that are costly for adversaries to alter. The speakers note that ATT&CK documents techniques well, and that a recent campaign they studied used many techniques already catalogued. Even so, many public Sigma analytics tied to those techniques missed the campaign, because they depended on low-level fields such as executable file names that an attacker can simply rename.
To address this, the team proposes a scoring model with two dimensions: the logic of the behavior being matched, from ephemeral values up to invariant technique behaviors, and the event source, from user-mode to kernel-mode telemetry. A scheduled task example shows a Sysmon rule scoring low, then rising as fields change, moving to Windows event 4688, and finally monitoring the registry key the scheduler reads. Each step can trade precision for robustness, so the speakers suggest mixing robust and less robust analytics in a SOC.
The takeaway for practitioners is to check which observables an adversary can easily change, and to favor behaviors that cannot be avoided without a substantially different implementation. The team scored about 40 Sigma analytics, and Sigma has since added a pyramid score tag to its rules. They invite help scoring other platforms, event sources and EDR telemetry, and critiques of the method.
Related talks
Talks·4 min
Amine Besson
Presents a homegrown platform that links threat models to detection rules and automates their deployment for a SOC.
Proving Ground·27 min
Rain Baker
Shows how Sigma's platform-neutral rule format lets defenders write detections once and translate them to many SIEMs and EDRs.
Talks·53 min
Tuomo Makkonen
Shows how collaborative purple teaming tests EDR, Active Directory and evasion gaps, then turns findings into fixes.


