{
  "scenario": "A provider handoff imports short history into an 8k window",
  "failsOnBase": true,
  "passesOnHead": true,
  "couldNotRun": null,
  "baseSha": "e2afd2546eb34fde33ac9fb24c052e8a9d63b519",
  "headSha": "fc41d6f270a5cad35da165d6f3fbad08d16be74d",
  "verdict": "Proven: the scenario fails on base `e2afd2546e` and passes on head `fc41d6f270`.",
  "steps": {
    "base": [
      {
        "step": "app.open <pairing link>",
        "status": "passed"
      },
      {
        "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/",
        "status": "passed"
      },
      {
        "step": "app.open /36b1a6c2-4b4a-4b55-9190-a926003f7536/mcp:64d12e42-85f6-4c3e-ab52-3636faf74b95",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: \"Multi turn\")",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Search models...\")",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"option\", name: /Luna 8k window/)",
        "status": "passed"
      },
      {
        "step": "browser.keyboard.press Escape",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Context handoff pending/) \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-pending",
        "status": "passed"
      },
      {
        "step": "locator.fill getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.press getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/^KESTREL-9042[.!]?$/).or(getByText(/The request leaves too little context for a provider handoff/)).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByRole(\"button\", name: \"Stop generation\") \u2192 hidden",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-result",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/^KESTREL-9042[.!]?$/)",
        "status": "failed"
      }
    ],
    "head": [
      {
        "step": "app.open <pairing link>",
        "status": "passed"
      },
      {
        "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/",
        "status": "passed"
      },
      {
        "step": "app.open /2348f82f-575e-4043-9d34-8d4c3714895b/mcp:0c5e7edf-6d9a-44bf-8f70-94964544b32f",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: \"Multi turn\")",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Search models...\")",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"option\", name: /Luna 8k window/)",
        "status": "passed"
      },
      {
        "step": "browser.keyboard.press Escape",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Context handoff pending/) \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-pending",
        "status": "passed"
      },
      {
        "step": "locator.fill getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.press getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/^KESTREL-9042[.!]?$/).or(getByText(/The request leaves too little context for a provider handoff/)).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByRole(\"button\", name: \"Stop generation\") \u2192 hidden",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-result",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/^KESTREL-9042[.!]?$/)",
        "status": "passed"
      }
    ]
  },
  "captures": [
    "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/001-handoff-pending.png",
    "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/002-handoff-result.png",
    "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/003-failure.png",
    "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/001-handoff-pending.png",
    "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/002-handoff-result.png"
  ],
  "videos": [
    "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/video/video.webm",
    "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/video/video.webm"
  ],
  "markdown": "### Scenario: A provider handoff imports short history into an 8k window\n\n**Proven: the scenario fails on base `e2afd2546e` and passes on head `fc41d6f270`.**\n\n|  | Base `e2afd2546e` | Head `fc41d6f270` |\n| --- | --- | --- |\n| Result | \u274c failed<br>ASSERTION_FAILED: expect.toBeVisible failed<br>locator: getByText(/^KESTREL-9042[.!]?$/)<br>expected: visible<br>observed: no node (match count 0) | \u2705 passed |\n| handoff pending | ![Base e2afd2546e: handoff pending](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/79da73412042bc52/001-handoff-pending.png) | ![Head fc41d6f270: handoff pending](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/6410379277f997f2/001-handoff-pending.png) |\n| handoff result | ![Base e2afd2546e: handoff result](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/b231814b9c14bfcb/002-handoff-result.png) | ![Head fc41d6f270: handoff result](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/bd3edf1d08cb026b/002-handoff-result.png) |\n| failure | ![Base e2afd2546e: failure](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/1db6a96dc351c1ed/003-failure.png) |  |\n",
  "base": {
    "sha": "e2afd2546eb34fde33ac9fb24c052e8a9d63b519",
    "status": "failed",
    "title": "A provider handoff imports short history into an 8k window",
    "message": "ASSERTION_FAILED: expect.toBeVisible failed\nlocator: getByText(/^KESTREL-9042[.!]?$/)\nexpected: visible\nobserved: no node (match count 0)",
    "steps": [
      {
        "step": "app.open <pairing link>",
        "status": "passed"
      },
      {
        "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/",
        "status": "passed"
      },
      {
        "step": "app.open /36b1a6c2-4b4a-4b55-9190-a926003f7536/mcp:64d12e42-85f6-4c3e-ab52-3636faf74b95",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: \"Multi turn\")",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Search models...\")",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"option\", name: /Luna 8k window/)",
        "status": "passed"
      },
      {
        "step": "browser.keyboard.press Escape",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Context handoff pending/) \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-pending",
        "status": "passed"
      },
      {
        "step": "locator.fill getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.press getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/^KESTREL-9042[.!]?$/).or(getByText(/The request leaves too little context for a provider handoff/)).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByRole(\"button\", name: \"Stop generation\") \u2192 hidden",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-result",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/^KESTREL-9042[.!]?$/)",
        "status": "failed"
      }
    ],
    "captures": [
      "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/001-handoff-pending.png",
      "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/002-handoff-result.png",
      "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/003-failure.png"
    ],
    "videos": [
      "<checkout>/.e2e/prove/base/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/video/video.webm"
    ]
  },
  "head": {
    "sha": "fc41d6f270a5cad35da165d6f3fbad08d16be74d",
    "status": "passed",
    "title": "A provider handoff imports short history into an 8k window",
    "steps": [
      {
        "step": "app.open <pairing link>",
        "status": "passed"
      },
      {
        "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/",
        "status": "passed"
      },
      {
        "step": "app.open /2348f82f-575e-4043-9d34-8d4c3714895b/mcp:0c5e7edf-6d9a-44bf-8f70-94964544b32f",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: \"Multi turn\")",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Search models...\")",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"option\", name: /Luna 8k window/)",
        "status": "passed"
      },
      {
        "step": "browser.keyboard.press Escape",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Context handoff pending/) \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-pending",
        "status": "passed"
      },
      {
        "step": "locator.fill getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.press getByRole(\"textbox\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/^KESTREL-9042[.!]?$/).or(getByText(/The request leaves too little context for a provider handoff/)).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByRole(\"button\", name: \"Stop generation\") \u2192 hidden",
        "status": "passed"
      },
      {
        "step": "app.screenshot handoff-result",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/^KESTREL-9042[.!]?$/)",
        "status": "passed"
      }
    ],
    "captures": [
      "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/001-handoff-pending.png",
      "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/screenshots/002-handoff-result.png"
    ],
    "videos": [
      "<checkout>/.e2e/prove/head/results/handoff-small-context-a-provider-handoff-imports-short-141c2e348da4ab14/attempt-1/video/video.webm"
    ]
  }
}