Practical LLM Security: Takeaways From a Year in the Trenches
Unknown
Black Hat USA 2024 · Day 1 · Briefing
This talk, "Practical LLM Security: Takeaways From a Year in the Trenches," delves into the pragmatic challenges and lessons learned from securing Large Language Model (LLM) integrations over the past year. Delivered by a seasoned expert from Nvidia's product security and AI red team, the presentation steers clear of theoretical or speculative AI risks, instead focusing squarely on the "classical security properties" of confidentiality, integrity, and availability as they manifest in real-world LLM deployments. The speaker emphasizes that many of the observed vulnerabilities stem from a fundamental misunderstanding of how LLMs operate at their core.