{
  "scenario": "Mobile thread settings explain the Homebrew stable cask ceiling",
  "failsOnBase": true,
  "passesOnHead": true,
  "couldNotRun": null,
  "baseSha": "2770bf3c61c4d6b7bb1f5d3df74aacf54ac7a159",
  "headSha": "bf3e5643d784139efcfc2b6d3cdb0c8bd43d91d6",
  "verdict": "Proven: the scenario fails on base `2770bf3c61` and passes on head `bf3e5643d7`.",
  "steps": {
    "base": [
      {
        "step": "device.setAppearance dark",
        "status": "passed"
      },
      {
        "step": "device.installApp <native-client-cache>/5eb3efb0a6fa1164ceec0ac7cce0ca513156c53a/T3CodeDev.app",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://expo-development-client/",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByRole(\"button\", name: \"Add environment\")",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://connections/new",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "failed"
      },
      {
        "step": "locator.tap getByText(\"Claude Fable availability\").first()",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: /Model and reasoning settings/)",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Find a model\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Claude Code.*v2.1.321/).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot mobile-model-picker",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/the claude-code Homebrew cask only has v2.1.311/).first()",
        "status": "failed"
      }
    ],
    "head": [
      {
        "step": "device.setAppearance dark",
        "status": "passed"
      },
      {
        "step": "device.installApp <native-client-cache>/5eb3efb0a6fa1164ceec0ac7cce0ca513156c53a/T3CodeDev.app",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://expo-development-client/",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByRole(\"button\", name: \"Add environment\")",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://connections/new",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "failed"
      },
      {
        "step": "locator.tap getByText(\"Claude Fable availability\").first()",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: /Model and reasoning settings/)",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Find a model\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Claude Code.*v2.1.321/).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot mobile-model-picker",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/the claude-code Homebrew cask only has v2.1.311/).first()",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/brew uninstall --cask claude-code && brew install --cask claude-code@latest/).first()",
        "status": "passed"
      }
    ]
  },
  "captures": [
    "base/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/001-mobile-model-picker.png",
    "base/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/002-failure.png",
    "head/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/001-mobile-model-picker.png"
  ],
  "videos": [],
  "markdown": "### Scenario: Mobile thread settings explain the Homebrew stable cask ceiling\n\n**Proven: the scenario fails on base `2770bf3c61` and passes on head `bf3e5643d7`.**\n\n|  | Base `2770bf3c61` | Head `bf3e5643d7` |\n| --- | --- | --- |\n| Result | \u274c failed<br>ASSERTION_FAILED: expect.toBeVisible failed<br>locator: getByText(/the claude-code Homebrew cask only has v2.1.311/).first()<br>expected: visible<br>observed: no node (match count 0) | \u2705 passed |\n| mobile model picker | ![Base 2770bf3c61: mobile model picker](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/53c0e23b5ddf5c83/001-mobile-model-picker.png) | ![Head bf3e5643d7: mobile model picker](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/39ffffe5c9ef7f52/001-mobile-model-picker.png) |\n| failure | ![Base 2770bf3c61: failure](https://gh-file-drop-api-prod-mi5fy3sowv63ufte.pinglabs.workers.dev/f/7a521e12b674e7c4/002-failure.png) |  |\n",
  "base": {
    "sha": "2770bf3c61c4d6b7bb1f5d3df74aacf54ac7a159",
    "status": "failed",
    "title": "Mobile thread settings explain the Homebrew stable cask ceiling",
    "message": "ASSERTION_FAILED: expect.toBeVisible failed\nlocator: getByText(/the claude-code Homebrew cask only has v2.1.311/).first()\nexpected: visible\nobserved: no node (match count 0)",
    "steps": [
      {
        "step": "device.setAppearance dark",
        "status": "passed"
      },
      {
        "step": "device.installApp <native-client-cache>/5eb3efb0a6fa1164ceec0ac7cce0ca513156c53a/T3CodeDev.app",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://expo-development-client/",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByRole(\"button\", name: \"Add environment\")",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://connections/new",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "failed"
      },
      {
        "step": "locator.tap getByText(\"Claude Fable availability\").first()",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: /Model and reasoning settings/)",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Find a model\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Claude Code.*v2.1.321/).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot mobile-model-picker",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/the claude-code Homebrew cask only has v2.1.311/).first()",
        "status": "failed"
      }
    ],
    "captures": [
      "base/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/001-mobile-model-picker.png",
      "base/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/002-failure.png"
    ],
    "videos": []
  },
  "head": {
    "sha": "bf3e5643d784139efcfc2b6d3cdb0c8bd43d91d6",
    "status": "passed",
    "title": "Mobile thread settings explain the Homebrew stable cask ceiling",
    "steps": [
      {
        "step": "device.setAppearance dark",
        "status": "passed"
      },
      {
        "step": "device.installApp <native-client-cache>/5eb3efb0a6fa1164ceec0ac7cce0ca513156c53a/T3CodeDev.app",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://expo-development-client/",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByRole(\"button\", name: \"Add environment\")",
        "status": "passed"
      },
      {
        "step": "device.openLink t3code-dev://connections/new",
        "status": "passed"
      },
      {
        "step": "device.alert accept",
        "status": "failed"
      },
      {
        "step": "locator.tap getByText(\"Claude Fable availability\").first()",
        "status": "passed"
      },
      {
        "step": "locator.tap getByRole(\"button\", name: /Model and reasoning settings/)",
        "status": "passed"
      },
      {
        "step": "locator.fill getByPlaceholder(\"Find a model\")",
        "status": "passed"
      },
      {
        "step": "locator.waitFor getByText(/Claude Code.*v2.1.321/).first() \u2192 visible",
        "status": "passed"
      },
      {
        "step": "app.screenshot mobile-model-picker",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/the claude-code Homebrew cask only has v2.1.311/).first()",
        "status": "passed"
      },
      {
        "step": "expect.toBeVisible getByText(/brew uninstall --cask claude-code && brew install --cask claude-code@latest/).first()",
        "status": "passed"
      }
    ],
    "captures": [
      "head/results/homebrew-claude-ceiling-mobile-mobile-thread-settings-explain-c392e01819a27e6b/attempt-1/screenshots/001-mobile-model-picker.png"
    ],
    "videos": []
  }
}