Prompt injection is when malicious user input manipulates the model into ignoring its system prompt instructions. Defences: clearly delimit untrusted input in the prompt (XML tags, explicit labelling), instruct the model to treat user content as data not commands, validate outputs, and use least-privilege tool access.
Back to All Posts
What is prompt injection and how do I defend against it?
Trusted by enterprises building the future
Add Comment