Shadow
Compare a candidate config against production replies, side-by-side.
| Time | Source | Skills | Diff | Failures | Verdict | |
|---|---|---|---|---|---|---|
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Anthropic API failed with 404: {"type":"error","error":{"type":"not_found_error","message":"model: chat-latest"},"request_id":"req_011CbnfRHN1P7rMW3zyn3Fyc"} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Anthropic API failed with 404: {"type":"error","error":{"type":"not_found_error","message":"model: chat-latest"},"request_id":"req_011CbnfF6XrXLeh1yKBUASPc"} | unreviewed | Review → | |
| Live | products Goggles | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Goggles | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Anthropic API failed with 404: {"type":"error","error":{"type":"not_found_error","message":"model: chat-latest"},"request_id":"req_011Cbg9K5LX5sys15orqXL3g"} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Anthropic API failed with 404: {"type":"error","error":{"type":"not_found_error","message":"model: chat-latest"},"request_id":"req_011Cbg9GfvJTNpMDiJCPeh8Y"} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Product advisor (Pam - Test) | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Stock and restock notifications | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | returns Return eligibility | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | missing-skill missing-skill | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → | |
| Live | products Claims and faulty products | Substantive | 1 failure shadow pipeline error: Bedrock failed with 400: {"message":"The provided model identifier is invalid."} | unreviewed | Review → |