stuntman / failures
Make the next call fail. Exactly as asked.
A rule says which requests, what to answer and how often. You, a test suite or an agent can turn it on, and the timeline marks every answer it changed.
How often is part of the rule.
- The first 2, then normal
- Every time
- Randomly, 25% of the requests
answered as the rule saysanswered normally
What you can provoke, line by line.
Arguments for every tool are in the tool reference.
| Line | Tools | Answers |
|---|---|---|
| HTTP APIs | force_answer · expire_tokens | any named answer or SOAP fault; reset, empty, timeout, 500, 503, HTML; cut or slow streams; invalid tokens |
| AI models | force_ai_failure | 429, 500, 529, content filter, length, broken tool arguments, slow, cut |
| SMS | force_sms_failure · reply_sms_as_user | 500, 400, reset, empty, timeout; the person texts back |
force_whatsapp_failure · send_bad_webhook | 500, 400, reset, empty, timeout; wrong, missing or old signature, replay | |
decide_held · simulate_recipient | deliver, defer, bounce, drop; open, click, spam report, unsubscribe | |
| Mailboxes | set_mailbox | login refused, busy, dropped fetch, TLS required, token expired |
| Storage | create_rule · set_next_read · set_next_use | any status, first N or a percentage; slow, truncated, bad MD5; bad links |
| Files | set_file_server | login refused, disk full, permission denied, cut halfway, slow, host key changed |
| Messaging | set_next_delivery (namespace) · set_namespace_reachability | lose lock, duplicate, hold, drop, dead-letter, out of order; refuse, busy |
| Streams | set_streams · rebalance | leader not available, SASL refused, slow fetch, duplicate, registry down; rebalance |
| Identity | provoke_sign_in · provoke_idp | MFA, consent, user cancels, wrong tenant, expired, IdP down |
| Secrets | provoke_secret · provoke_key · provoke_certificate | 403, 404, 429, disabled, slow, expired, untrusted |
| Webhook inboxes | set_inbox | fail N times then succeed, delay, hang, redirect |
| Product events | force_events_failure | 400, 413, 429, slow, drop half |
| Telemetry | provoke_collector | 401, 403, 429, 503, refused, slow, drop half |
A rule is a file, too.
Edit it in the UI and try it against the last 50 requests before saving. It is saved in storage/rules/<service>.yaml, and an agent creates the same rule with one tool call.
create_rule {
"service": "azure-blob",
"name": "Contract uploads fail twice",
"when": {"op": "put", "container": "documents",
"path": "contracts/**"},
"then": {"respond": "503"},
"how_often": {"first": 2}
}
Which calls it catches, what they answer and for how many: try it against the last 50 requests before saving.
Callbacks your app must verify.
Stuntman signs callbacks the way each provider does: ECDSA for SendGrid, the app secret for Meta, HMAC for your own inboxes, and Stripe, Svix, GitHub or CloudEvents signatures for plugin webhooks. Ask for a badly signed, old, repeated or replayed one and check that your app rejects it.
send_bad_webhook {"kind": "wrong_signature"}
→ acme-api answered 401