Headroom: A Context Optimization Layer for LLM Applications
Explores headroom: A Context Optimization Layer for LLM Applications and evaluates key implications for security practitioners.
Summary
No summary yet — watch the video above, or open it on YouTube.
Related talks
The Linux Foundation·28 min
Aurick Qiao
Reviews arctic Inference: Open-Source LLM Inference Optimizations at Snowflake and evaluates key implications for security practitioners.
Black Hat·37 min
Xiangfan Wu · Lingyun Ying · Guoqiang Chen · Yacong Gu · Haipeng Qu
Engineers explore architecture and security mechanisms for Cache Me, Catch You: Exploiting LLM Caching Layers in vLLM, GPTCache & Friends.
The Linux Foundation·32 min
Seokhwan Kong
Outlines beyond Round-Robin: GPU-Aware Load Balancing for LLM Inference in Kubernetes and evaluates key implications for security practitioners.