$ node scripts/prove-scenario.ts scripts/scenarios/timeline-review-toggle.e2e.ts --base 5842231421d0058f1ca7e829a66f648cb472aff1 --head 70753d8b8a40fe12915f1358426a860d2be053de --upload-command 'ghdrop upload' ⊘ cache disabled Scope: all 43 workspace projects ✓ Lockfile passes supply-chain policies (verified 16m ago) Lockfile is up to date, resolution step is skipped Packages are hard linked from the content-addressable store to the virtual store. Content-addressable store is at: Virtual store is at: node_modules/.pnpm Progress: resolved 884, reused 884, downloaded 0, added 869 Progress: resolved 1436, reused 1436, downloaded 0, added 1420 Progress: resolved 1776, reused 1776, downloaded 0, added 1774 Packages: +1780 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Progress: resolved 1780, reused 1776, downloaded 0, added 1780, done Agent skills awaiting approval: e2e. Run "pnpm approve" to review them. . prepare$ vp config --no-agent . prepare: Done devDependencies: + @coderabbitai/config 1.2.0 + @effect/tsgo 0.67.1 + @shadcn/lint 0.1.5 + @types/node 24.12.4 + knip 6.34.0 + vite-plus 1.4.0 Done in 4.7s using pnpm v12.14.0 RUN e2e v0.23.0 run 01a1e9d0-fcd9-7a29-bf6c-a4d9bcbd8bc0 · targets: web, ios ✓ target "web" command at http://127.0.0.1:41945/.well-known/t3/environment ready 7.08s × |web| scenarios/timeline-review-toggle.e2e.ts > Two clicks at the timeline chevron collapse without unresolving 43.53s → expect.toHaveAttribute failed ❯ |web| scenarios/timeline-review-toggle.e2e.ts (1 test | 1 failed) 43.53s ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Failed Tests 1 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ FAIL |web| scenarios/timeline-review-toggle.e2e.ts > Two clicks at the timeline chevron collapse without unresolving ASSERTION_FAILED: expect.toHaveAttribute failed locator: getByRole("button", name: /^math\.js:2/) expected: attribute "aria-expanded" "false" observed: attribute "aria-expanded" "true" (match count 1) ❯ scenarios/timeline-review-toggle.e2e.ts:35:3 33| await browser.evaluate(() => document.body.innerText); 34| await app.screenshot("03-second-click"); 35| await expect(toggle).toHaveAttribute("aria-expanded", "false"); | ^ 36| await expect(toggle).toContainText("Resolved"); 37| }); ❯ at http://127.0.0.1:41945/pull-requests?involvement=all&state=open&repository=julius54%2Ftimeline-toggle-proof-38141&number=1&selectedHost=gitlab.com&selectedProjectId=1360f97b-9151-42bd-9a7f-eeceac58e281&selectedEnvironmentId=f2e86070-f473-4c3c-b7ab-4b24df9f8675 ❯ app 1 warning logged ❯ trace .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/trace.md ❯ video .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/video/video.webm ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/1]⎯ Test Files 1 failed | 0 passed (1) Tests 1 failed | 0 passed (1) Start at 14:02:30 Duration 51.98s (startup 7.08s) Traces .e2e/prove/base/results/ (1 page, trace.md in each test's directory) Screenshots .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/001-01-collapsed.png .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/002-02-expanded.png .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/003-03-second-click.png Markdown .e2e/prove/base/summary.md Failed × |web| scenarios/timeline-review-toggle.e2e.ts:35 > Two clicks at the timeline chevron collapse without unresolving ASSERTION_FAILED: expect.toHaveAttribute failed trace .e2e/prove/base/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/trace.md Scope: all 43 workspace projects ✓ Lockfile passes supply-chain policies (verified 18m ago) Lockfile is up to date, resolution step is skipped Packages are hard linked from the content-addressable store to the virtual store. Content-addressable store is at: Virtual store is at: node_modules/.pnpm Progress: resolved 912, reused 912, downloaded 0, added 897 Progress: resolved 1653, reused 1653, downloaded 0, added 1639 Packages: +1780 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Progress: resolved 1780, reused 1776, downloaded 0, added 1780, done Agent skills awaiting approval: e2e. Run "pnpm approve" to review them. . prepare$ vp config --no-agent . prepare: Done devDependencies: + @coderabbitai/config 1.2.0 + @effect/tsgo 0.67.1 + @shadcn/lint 0.1.5 + @types/node 24.12.4 + knip 6.34.0 + vite-plus 1.4.0 Done in 5.1s using pnpm v12.14.0 RUN e2e v0.23.0 run 01a1e9d2-13a9-7f9c-960d-c6ccd6d98790 · targets: web, ios ✓ target "web" command at http://127.0.0.1:41687/.well-known/t3/environment ready 10.62s ✓ |web| scenarios/timeline-review-toggle.e2e.ts > Two clicks at the timeline chevron collapse without unresolving 20.69s ✓ |web| scenarios/timeline-review-toggle.e2e.ts (1 test) 20.69s Test Files 1 passed (1) Tests 1 passed (1) Start at 14:03:43 Duration 33.02s (startup 10.62s) Traces .e2e/prove/head/results/ (1 page, trace.md in each test's directory) Screenshots .e2e/prove/head/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/001-01-collapsed.png .e2e/prove/head/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/002-02-expanded.png .e2e/prove/head/results/timeline-review-toggle-two-clicks-at-the-timeline-98b62ce189b94194/attempt-1/screenshots/003-03-second-click.png Markdown .e2e/prove/head/summary.md { "scenario": "Two clicks at the timeline chevron collapse without unresolving", "failsOnBase": true, "passesOnHead": true, "couldNotRun": null, "baseSha": "5842231421d0058f1ca7e829a66f648cb472aff1", "headSha": "70753d8b8a40fe12915f1358426a860d2be053de", "verdict": "Proven: the scenario fails on base `5842231421` and passes on head `70753d8b8a`.", "steps": { "base": [ { "step": "app.open ", "status": "passed" }, { "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/", "status": "passed" }, { "step": "app.open /f2e86070-f473-4c3c-b7ab-4b24df9f8675/mcp:1d8ab48c-6cee-4096-8c82-918302bda23a", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Pull requests\").first()", "status": "passed" }, { "step": "locator.tap getByText(\"Add math helper\").first()", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Timeline\")", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: /^math\\.js:2/) → visible", "status": "passed" }, { "step": "app.screenshot 01-collapsed", "status": "passed" }, { "step": "browser.mouse.move ", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: \"Unresolve\") → visible", "status": "passed" }, { "step": "app.screenshot 02-expanded", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "browser.evaluate ", "status": "passed" }, { "step": "app.screenshot 03-second-click", "status": "passed" }, { "step": "expect.toHaveAttribute getByRole(\"button\", name: /^math\\.js:2/)", "status": "failed" } ], "head": [ { "step": "app.open ", "status": "passed" }, { "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/", "status": "passed" }, { "step": "app.open /7ff2b967-d6d8-4a0c-8887-c75c634e5830/mcp:d129b582-d93c-437e-8b28-8185df9b1fce", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Pull requests\").first()", "status": "passed" }, { "step": "locator.tap getByText(\"Add math helper\").first()", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Timeline\")", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: /^math\\.js:2/) → visible", "status": "passed" }, { "step": "app.screenshot 01-collapsed", "status": "passed" }, { "step": "browser.mouse.move ", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: \"Unresolve\") → visible", "status": "passed" }, { "step": "app.screenshot 02-expanded", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "browser.evaluate ", "status": "passed" }, { "step": "app.screenshot 03-second-click", "status": "passed" }, { "step": "expect.toHaveAttribute getByRole(\"button\", name: /^math\\.js:2/)", "status": "passed" }, { "step": "expect.toContainText getByRole(\"button\", name: /^math\\.js:2/)", "status": "passed" } ] }, "captures": [ "", "", "", "", "", "", "" ], "videos": [ "", "" ], "markdown": "### Scenario: Two clicks at the timeline chevron collapse without unresolving\n\n**Proven: the scenario fails on base `5842231421` and passes on head `70753d8b8a`.**\n\n| | Base `5842231421` | Head `70753d8b8a` |\n| --- | --- | --- |\n| Result | ❌ failed
ASSERTION_FAILED: expect.toHaveAttribute failed
locator: getByRole(\"button\", name: /^math\\.js:2/)
expected: attribute \"aria-expanded\" \"false\"
observed: attribute \"aria-expanded\" \"true\" (match count 1) | ✅ passed |\n| 01 collapsed | ![Base 5842231421: 01 collapsed](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/c6e695bd5a54b56b/001-01-collapsed.png) | ![Head 70753d8b8a: 01 collapsed](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/bc7066ee6b3e5755/001-01-collapsed.png) |\n| 02 expanded | ![Base 5842231421: 02 expanded](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/db91f4f5b1c61415/002-02-expanded.png) | ![Head 70753d8b8a: 02 expanded](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/31fd93fc3f294b8f/002-02-expanded.png) |\n| 03 second click | ![Base 5842231421: 03 second click](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/6e8a8309b4b7f855/003-03-second-click.png) | ![Head 70753d8b8a: 03 second click](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/efdbd220a7f30ce9/003-03-second-click.png) |\n| failure | ![Base 5842231421: failure](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/4acd3f8e06908deb/004-failure.png) | |\n", "base": { "sha": "5842231421d0058f1ca7e829a66f648cb472aff1", "status": "failed", "title": "Two clicks at the timeline chevron collapse without unresolving", "message": "ASSERTION_FAILED: expect.toHaveAttribute failed\nlocator: getByRole(\"button\", name: /^math\\.js:2/)\nexpected: attribute \"aria-expanded\" \"false\"\nobserved: attribute \"aria-expanded\" \"true\" (match count 1)", "steps": [ { "step": "app.open ", "status": "passed" }, { "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/", "status": "passed" }, { "step": "app.open /f2e86070-f473-4c3c-b7ab-4b24df9f8675/mcp:1d8ab48c-6cee-4096-8c82-918302bda23a", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Pull requests\").first()", "status": "passed" }, { "step": "locator.tap getByText(\"Add math helper\").first()", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Timeline\")", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: /^math\\.js:2/) → visible", "status": "passed" }, { "step": "app.screenshot 01-collapsed", "status": "passed" }, { "step": "browser.mouse.move ", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: \"Unresolve\") → visible", "status": "passed" }, { "step": "app.screenshot 02-expanded", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "browser.evaluate ", "status": "passed" }, { "step": "app.screenshot 03-second-click", "status": "passed" }, { "step": "expect.toHaveAttribute getByRole(\"button\", name: /^math\\.js:2/)", "status": "failed" } ], "captures": [ "", "", "", "" ], "videos": [ "" ] }, "head": { "sha": "70753d8b8a40fe12915f1358426a860d2be053de", "status": "passed", "title": "Two clicks at the timeline chevron collapse without unresolving", "steps": [ { "step": "app.open ", "status": "passed" }, { "step": "expect.not.toHaveURL /\\/pair(?:[?#]|$)/", "status": "passed" }, { "step": "app.open /7ff2b967-d6d8-4a0c-8887-c75c634e5830/mcp:d129b582-d93c-437e-8b28-8185df9b1fce", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Pull requests\").first()", "status": "passed" }, { "step": "locator.tap getByText(\"Add math helper\").first()", "status": "passed" }, { "step": "locator.tap getByRole(\"button\", name: \"Timeline\")", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: /^math\\.js:2/) → visible", "status": "passed" }, { "step": "app.screenshot 01-collapsed", "status": "passed" }, { "step": "browser.mouse.move ", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "locator.waitFor getByRole(\"button\", name: \"Unresolve\") → visible", "status": "passed" }, { "step": "app.screenshot 02-expanded", "status": "passed" }, { "step": "browser.mouse.down ", "status": "passed" }, { "step": "browser.mouse.up ", "status": "passed" }, { "step": "browser.evaluate ", "status": "passed" }, { "step": "app.screenshot 03-second-click", "status": "passed" }, { "step": "expect.toHaveAttribute getByRole(\"button\", name: /^math\\.js:2/)", "status": "passed" }, { "step": "expect.toContainText getByRole(\"button\", name: /^math\\.js:2/)", "status": "passed" } ], "captures": [ "", "", "" ], "videos": [ "" ] } }