The Linux Foundation·7 min
Evaline Ju
Outlines lightning Talk: Serving Guardrail Detectors on Vllm and evaluates key implications for security practitioners.
lightningservingguardrail+2
vllm
2 talks tagged with this topic.
Filters+
Loading filters…
1–2 of 2 talks · loading…
The Linux Foundation·40 min
Junchen Jiang · Yue Zhu
Discusses scalable and Efficient LLM Serving With the VLLM Production Stack and evaluates key implications for security practitioners.
llmscalableefficient+2