Menu

Post image 1
Post image 2
1 / 2
0

Why we ship untested prompts (and the supply-chain pattern that fixes it)

DEV Community·rp1run·about 1 month ago
#m6amdP7K
#ai#devops#security#prompt#code#change
Reading 0:00
15s threshold

I'd never approve a PR that bypassed CI. But I've watched dozens of teams — including ones I've worked on — deploy prompt changes with zero of the verification we'd insist on for a code change. Edit a string in a config file. Push. Hope. A prompt change is a logic change. It alters how the system behaves under uncertainty, what it returns under load, and how it handles edge cases nobody enumerated. The fact that it's text and not Python doesn't change what it does. The gap between how we deploy code and how we deploy prompts is going to bite hard as agentic systems scale. And the answer might already exist — in the tooling the supply-chain security world has been building for the last five years. The supply-chain parallel Sigstore, SLSA, in-toto. These tools solved a related problem for binaries: how do you cryptographically prove that the artifact in production is the one that passed your checks? The primitives: Content-addressable hashing. Identify the artifact by the hash of its content.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More