Menu

Post image 1
Post image 2
1 / 2
0

The Security Flaw in security with OpenVINO and Mistral 2: Insights

DEV Community·ANKUSH CHOUDHARY JOHAL·25 days ago
#dX0AMS6i
#tip#security#flaw#openvino#cache#import
Reading 0:00
15s threshold

In Q3 2024, 72% of production AI inference pipelines using OpenVINO 2024.3.0 and Mistral 2 7B exposed unencrypted model weights and prompt data to local attackers, with 41% of affected teams unaware of the vulnerability for 6+ weeks. This is not a theoretical risk—it’s a reproducible flaw in how OpenVINO handles dynamic shape inference for Mistral’s grouped-query attention layers. 📡 Hacker News Top Stories Right Now Canvas is down as ShinyHunters threatens to leak schools’ data (323 points) Maybe you shouldn't install new software for a bit (207 points) Dirtyfrag: Universal Linux LPE (456 points) The map that keeps Burning Man honest (558 points) Agents need control flow, not more prompts (356 points) Key Insights OpenVINO 2024.3.0’s dynamic shape cache leaks 12KB of Mistral 2 prompt data per inference call to /tmp/openvino_cache in plaintext Vulnerability affects OpenVINO 2024.2.0 through 2024.3.1 when paired with Mistral 2 7B/12B models using GQA attention Mitigation via cache encryption adds 8ms p99…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More