Issue 11872 — actual OpenSSH/runtime evidence, 2026-10-22 UTC Requested HEAD d2298847909b2d80ad4ebea8751368fd3ab6c479 Base 3b95e7831b11b17627dff16843bc087bfca397ec Final observed HEAD a96bd98149a3f5b444ba28e54489433816ac3b76 PROVENANCE WARNING: Parent advanced HEAD during capture. Individual logs print the HEAD observed at start. Only tunnel.test.ts changed between requested and final HEAD (106 insertions, 52 deletions). Runtime tunnel.ts blob is identical at both: 5757233e1d393df3f220bbb2988707c5d29fd264. After-manager imports current source; raw MANAGER_SOURCE/SERVER_SOURCE labels name the originally requested runtime revision, not a frozen checkout. Base manager uses a scratch git-show copy of base tunnel.ts with imports pointed to unchanged current dependencies; actual server source is unchanged between base and either head. No production source edits or commits by this test agent. Environment: Linux x86_64, OpenSSH_9.6p1 Ubuntu-3ubuntu13.19, Node v24.21.0, real sshd 127.0.0.1:41187, disposable user t3issue11872 HOME /tmp/issue-11872-runtime/home. Actual SshEnvironmentManager with real process/network/HTTP layers; source apps/server/src/bin.ts with built apps/web/dist. No mocks, Vite, browser, desktop UI or live T3 state. Each ensure awaits actual manager HTTP readiness. Captured tunnel handle is terminated via handle.kill(SIGTERM), awaited via exitCode, then ensure is called again. Disconnect uses manager.disconnectEnvironment. Configuration: client authenticates with fixture-only IdentityFile, IdentitiesOnly yes, StrictHostKeyChecking no; ForwardAgent printed via ssh -G per run. Remote project origin is ssh://t3issue11872@127.0.0.1:41187/tmp/issue-11872-runtime/home/origin.git; git core.sshCommand uses BatchMode=yes, IdentityFile=none, fixture known_hosts. No private key exists in remote home. Only disposable test identity is loaded. Probe reads actual server /proc/PID/environ and runs test -S, ssh-add -l, git fetch origin and git pull as that user using exactly its SSH_AUTH_SOCK (or unset). This proves environment authentication, not a Git RPC or desktop flow. Commands: PATH=/bin:$PATH REPRO_RECONNECT=1 PROOF_BASE=0|1 node .t3/issue-11872/proof-manager.ts. Scratch harness extends parent manager.ts with absence-aware/external-PID probe and post-disconnect inspection. For no-forward/stable-agent rows SSH_AUTH_SOCK=/local-agent.sock (forwarding disabled). For final forwarded and external rows actual command additionally sets PROOF_LOCAL_SOCK=/proof-local-agent.sock; run-proof.py supplies that SSH_AUTH_SOCK to node. Raw COMMAND lines retained below were static labels and say local-agent.sock; this paragraph corrects them. The original parent's local agent socket later refused connections; those invalid forwarded attempts were discarded and replaced with final runs using our separately owned agent. Parent's agent was never stopped or modified. Stable override setup: sudo -u t3issue11872 ssh-agent -a /stable-agent.sock -s; capture returned PID; sudo -u t3issue11872 env SSH_AUTH_SOCK=/stable-agent.sock ssh-add - < fixture clientkey. Login .profile exports PATH and SSH_AUTH_SOCK. ForwardAgent=no. Both base/head prove independent agent auth after launch/reconnect; managed server stopped before next row, persistent agent continues into next launch. External setup: sudo -u t3issue11872 env SSH_AUTH_SOCK=/stable-agent.sock T3CODE_NO_BROWSER=1 /usr/local/nvm/versions/node/v24.21.0/bin/node /home/ubuntu/wt/issue-11872/apps/server/src/bin.ts serve --host 127.0.0.1 --port 3774 --base-dir /.t3. Capture owner Popen PID and server-published runtime PID, do not write manager pid/port/managed files. Restore login profile to PATH only before adoption. ForwardAgent=yes and working separately owned local agent. Same external server reused across base/head. Server original stable env must remain while tunnel link follows forwarded sessions. Both disconnects leave external server alive; owner stops it afterward. Stable agent ssh-add succeeds after both disconnects. Expected observations / actual results: R1 fresh forwarded managed launch: base dead inherited session socket, test-S=1 ssh-add=2 fetch=128 pull=1; head live stable agent.sock, all four=0. R2 forced captured tunnel drop/reconnect: same server PID per revision; base auth stays broken; head link target changes to new live forwarded session, all four=0. Final disconnect stops managed server; dangling link may remain but live_socket=False. R3 ForwardAgent=no/no shell agent: base/head server socket absent, link absent on launch and reconnect; test-S=1 ssh-add=2 fetch=128 pull=1 expected. HTTP manager ensure succeeds, same server PID, manager exit=0. No forced forwarding flags. R4 ForwardAgent=no/stable shell agent: base direct stable socket; head stable state-dir link points to remote agent. Each launch/reconnect all four=0, same PID; independent agent survives managed lifecycle. R5 external: base/head serverKind=external, same independently owned PID and stable original server socket; all four=0 after ensure/reconnect. Head link changes forwarded target but server environment is unchanged. Post disconnect server state=S (alive), stable agent survives. Owner then stops both. R1/R2 final runs use current HEAD a96bd98149a3f5b444ba28e54489433816ac3b76 with byte-identical runtime implementation to requested d229884790. R3/R4 were captured at requested HEAD. R5 final runs use current HEAD. Parent-supplied red and 22/22 green logs follow verbatim; green predates newer test-only commit, so no green result for final HEAD is claimed. This capture is not final branch approval until parent binds refreshed test proof/current HEAD. Desktop macOS UI cannot-verify; mobile unchanged. Zero visual rows: no changed rendering. No screenshots/recordings required or taken. ===== forwarded-before (raw actual runtime) ===== ROW=forwarded REV=before HEAD=a96bd98149a3f5b444ba28e54489433816ac3b76 MANAGER_SOURCE=3b95e7831b (scratch copy of base tunnel; unchanged dependencies) SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=1 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent yes PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [08:01:19.847] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:01:19.883] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:01:26.574] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [08:01:26.949] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '36181:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 696196, localPort: 36181, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:36181/' } [08:01:26.950] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36181, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:36181/","wsBaseUrl":"ws://127.0.0.1:36181/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 695613 SERVER_SSH_AUTH_SOCK: /tmp/ssh-kkuorxzGOv/agent.695381 AGENT_LINK: absent command: test -S /tmp/ssh-kkuorxzGOv/agent.695381 exit: 1 command: ssh-add -l exit: 2 Error connecting to agent: No such file or directory command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. DROP_TUNNEL 696196 [08:01:27.630] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:01:29.663] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:36181/', requestUrl: 'http://127.0.0.1:36181/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:36181/.', cause: [Object] } } } [08:01:29.664] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36181, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [08:01:29.666] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36181, remotePort: 3774 } [08:01:29.668] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:01:30.678] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [08:01:31.042] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '36907:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 696708, localPort: 36907, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:36907/' } [08:01:31.043] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36907, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:36907/","wsBaseUrl":"ws://127.0.0.1:36907/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 695613 SERVER_SSH_AUTH_SOCK: /tmp/ssh-kkuorxzGOv/agent.695381 AGENT_LINK: absent command: test -S /tmp/ssh-kkuorxzGOv/agent.695381 exit: 1 command: ssh-add -l exit: 2 Error connecting to agent: No such file or directory command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. [08:01:31.668] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [08:01:31.686] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36907, remotePort: 3774 } [08:01:31.687] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:01:33.355] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:01:33.355] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 695613 POST_DISCONNECT_AGENT_LINK: False live_socket= False MANAGER_EXIT=0 ===== forwarded-after (raw actual runtime) ===== ROW=forwarded REV=after HEAD=a96bd98149a3f5b444ba28e54489433816ac3b76 MANAGER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=0 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent yes PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [08:01:34.243] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:01:34.267] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:01:43.230] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [08:01:43.612] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '42693:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 697732, localPort: 42693, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:42693/' } [08:01:43.612] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 42693, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:42693/","wsBaseUrl":"ws://127.0.0.1:42693/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 697070 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock AGENT_LINK: /tmp/ssh-ycUbZlm4Uy/agent.697735 command: test -S /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. DROP_TUNNEL 697732 [08:01:44.260] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:01:46.276] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:42693/', requestUrl: 'http://127.0.0.1:42693/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:42693/.', cause: [Object] } } } [08:01:46.277] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 42693, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [08:01:46.280] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 42693, remotePort: 3774 } [08:01:46.281] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:01:46.825] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [08:01:47.188] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '33275:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 698494, localPort: 33275, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:33275/' } [08:01:47.188] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 33275, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:33275/","wsBaseUrl":"ws://127.0.0.1:33275/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 697070 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock AGENT_LINK: /tmp/ssh-GcQd3eDMdr/agent.698504 command: test -S /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. [08:01:47.828] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [08:01:47.844] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 33275, remotePort: 3774 } [08:01:47.844] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:01:48.689] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:01:48.689] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 697070 POST_DISCONNECT_AGENT_LINK: True live_socket= False MANAGER_EXIT=0 ===== no-forward-before (raw actual runtime) ===== ROW=no-forward REV=before HEAD=d2298847909b2d80ad4ebea8751368fd3ab6c479 MANAGER_SOURCE=3b95e7831b (scratch copy of base tunnel; unchanged dependencies) SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=1 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent no PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [07:28:13.330] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:28:13.355] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:28:21.288] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:28:21.541] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '35959:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 666434, localPort: 35959, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:35959/' } [07:28:21.542] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35959, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:35959/","wsBaseUrl":"ws://127.0.0.1:35959/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 666077 SERVER_SSH_AUTH_SOCK: None AGENT_LINK: absent command: test -S /nonexistent-proof-socket exit: 1 command: ssh-add -l exit: 2 Could not open a connection to your authentication agent. command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. DROP_TUNNEL 666434 [07:28:22.024] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:28:24.038] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:35959/', requestUrl: 'http://127.0.0.1:35959/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:35959/.', cause: [Object] } } } [07:28:24.039] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35959, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [07:28:24.041] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35959, remotePort: 3774 } [07:28:24.041] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:28:24.597] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:28:24.871] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '35791:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 667304, localPort: 35791, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:35791/' } [07:28:24.871] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35791, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:35791/","wsBaseUrl":"ws://127.0.0.1:35791/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 666077 SERVER_SSH_AUTH_SOCK: None AGENT_LINK: absent command: test -S /nonexistent-proof-socket exit: 1 command: ssh-add -l exit: 2 Could not open a connection to your authentication agent. command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. [07:28:25.430] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [07:28:25.466] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35791, remotePort: 3774 } [07:28:25.467] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:28:26.419] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:28:26.419] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 666077 POST_DISCONNECT_AGENT_LINK: False live_socket= False MANAGER_EXIT=0 ===== no-forward-after (raw actual runtime) ===== ROW=no-forward REV=after HEAD=d2298847909b2d80ad4ebea8751368fd3ab6c479 MANAGER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=0 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent no PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [07:28:38.483] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:28:38.508] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:28:47.487] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:28:48.509] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '41345:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 668847, localPort: 41345, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:41345/' } [07:28:48.510] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 41345, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:41345/","wsBaseUrl":"ws://127.0.0.1:41345/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 667907 SERVER_SSH_AUTH_SOCK: None AGENT_LINK: absent command: test -S /nonexistent-proof-socket exit: 1 command: ssh-add -l exit: 2 Could not open a connection to your authentication agent. command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. DROP_TUNNEL 668847 [07:28:49.345] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:28:51.368] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:41345/', requestUrl: 'http://127.0.0.1:41345/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:41345/.', cause: [Object] } } } [07:28:51.369] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 41345, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [07:28:51.372] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 41345, remotePort: 3774 } [07:28:51.373] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:28:53.096] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:28:54.008] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '36201:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 669366, localPort: 36201, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:36201/' } [07:28:54.009] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36201, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:36201/","wsBaseUrl":"ws://127.0.0.1:36201/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 667907 SERVER_SSH_AUTH_SOCK: None AGENT_LINK: absent command: test -S /nonexistent-proof-socket exit: 1 command: ssh-add -l exit: 2 Could not open a connection to your authentication agent. command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 128 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. command: git -C /tmp/issue-11872-runtime/home/project pull exit: 1 t3issue11872@127.0.0.1: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. [07:28:54.946] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [07:28:54.972] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 36201, remotePort: 3774 } [07:28:54.973] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:28:56.200] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:28:56.200] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 667907 POST_DISCONNECT_AGENT_LINK: False live_socket= False MANAGER_EXIT=0 ===== stable-agent-before (raw actual runtime) ===== ROW=stable-agent REV=before HEAD=d2298847909b2d80ad4ebea8751368fd3ab6c479 MANAGER_SOURCE=3b95e7831b (scratch copy of base tunnel; unchanged dependencies) SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=1 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent no PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin export SSH_AUTH_SOCK=/tmp/issue-11872-runtime/home/stable-agent.sock [07:58:39.079] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:58:39.106] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:58:51.558] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:58:51.815] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '45709:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 675695, localPort: 45709, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:45709/' } [07:58:51.816] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45709, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:45709/","wsBaseUrl":"ws://127.0.0.1:45709/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 674638 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: absent command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. DROP_TUNNEL 675695 [07:58:52.501] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:58:54.515] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:45709/', requestUrl: 'http://127.0.0.1:45709/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:45709/.', cause: [Object] } } } [07:58:54.516] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45709, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [07:58:54.518] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45709, remotePort: 3774 } [07:58:54.518] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:58:55.009] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:58:55.275] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '38779:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 676765, localPort: 38779, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:38779/' } [07:58:55.279] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 38779, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:38779/","wsBaseUrl":"ws://127.0.0.1:38779/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 674638 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: absent command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. [07:58:55.887] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [07:58:55.905] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 38779, remotePort: 3774 } [07:58:55.906] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:58:56.640] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:58:56.641] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 674638 POST_DISCONNECT_AGENT_LINK: False live_socket= False MANAGER_EXIT=0 ===== stable-agent-after (raw actual runtime) ===== ROW=stable-agent REV=after HEAD=d2298847909b2d80ad4ebea8751368fd3ab6c479 MANAGER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=0 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent no PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin export SSH_AUTH_SOCK=/tmp/issue-11872-runtime/home/stable-agent.sock [07:58:57.327] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:58:57.354] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:59:04.069] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:59:04.441] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '39723:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 679327, localPort: 39723, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:39723/' } [07:59:04.442] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 39723, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:39723/","wsBaseUrl":"ws://127.0.0.1:39723/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 677844 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock AGENT_LINK: /tmp/issue-11872-runtime/home/stable-agent.sock command: test -S /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. DROP_TUNNEL 679327 [07:59:05.060] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [07:59:07.074] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:39723/', requestUrl: 'http://127.0.0.1:39723/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:39723/.', cause: [Object] } } } [07:59:07.075] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 39723, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [07:59:07.077] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 39723, remotePort: 3774 } [07:59:07.078] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [07:59:07.529] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'managed', stateKey: 'e19b096f53873bed' } [07:59:07.908] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '42657:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 680854, localPort: 42657, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:42657/' } [07:59:07.909] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 42657, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:42657/","wsBaseUrl":"ws://127.0.0.1:42657/","pairingToken":null,"remotePort":3774,"remoteServerKind":"managed"} SERVER_PID: 677844 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock AGENT_LINK: /tmp/issue-11872-runtime/home/stable-agent.sock command: test -S /tmp/issue-11872-runtime/home/.t3/ssh-launch/e19b096f53873bed/agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. [07:59:08.537] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [07:59:08.551] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 42657, remotePort: 3774 } [07:59:08.552] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:59:09.406] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [07:59:09.406] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: gone pid= 677844 POST_DISCONNECT_AGENT_LINK: True live_socket= True MANAGER_EXIT=0 ===== external-before (raw actual runtime) ===== ROW=external REV=before HEAD=a96bd98149a3f5b444ba28e54489433816ac3b76 MANAGER_SOURCE=3b95e7831b (scratch copy of base tunnel; unchanged dependencies) SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=1 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent yes PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [08:02:12.364] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:02:12.390] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:02:13.136] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'external', stateKey: 'e19b096f53873bed' } [08:02:13.451] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '45513:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 700270, localPort: 45513, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:45513/' } [08:02:13.451] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45513, remotePort: 3774, remoteServerKind: 'external', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:45513/","wsBaseUrl":"ws://127.0.0.1:45513/","pairingToken":null,"remotePort":3774,"remoteServerKind":"external"} SERVER_PID: 698931 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: absent command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. DROP_TUNNEL 700270 [08:02:14.056] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:02:16.068] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:45513/', requestUrl: 'http://127.0.0.1:45513/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:45513/.', cause: [Object] } } } [08:02:16.069] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45513, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [08:02:16.071] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 45513, remotePort: 3774 } [08:02:16.072] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:02:16.553] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'external', stateKey: 'e19b096f53873bed' } [08:02:16.813] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '33505:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1' ], pid: 701588, localPort: 33505, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:33505/' } [08:02:16.814] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 33505, remotePort: 3774, remoteServerKind: 'external', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:33505/","wsBaseUrl":"ws://127.0.0.1:33505/","pairingToken":null,"remotePort":3774,"remoteServerKind":"external"} SERVER_PID: 698931 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: absent command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. [08:02:17.443] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [08:02:17.457] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 33505, remotePort: 3774 } [08:02:17.458] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:02:17.696] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:02:17.696] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: state=S pid= 698931 POST_DISCONNECT_AGENT_LINK: False live_socket= False MANAGER_EXIT=0 ===== external-after (raw actual runtime) ===== ROW=external REV=after HEAD=a96bd98149a3f5b444ba28e54489433816ac3b76 MANAGER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 SERVER_SOURCE=d2298847909b2d80ad4ebea8751368fd3ab6c479 (server files unchanged by fix) COMMAND=PATH=/bin:$PATH SSH_AUTH_SOCK=/local-agent.sock REPRO_RECONNECT=1 PROOF_BASE=0 node .t3/issue-11872/proof-manager.ts EFFECTIVE_CONFIG: user t3issue11872 hostname 127.0.0.1 port 41187 forwardagent yes PROFILE: export PATH=/usr/local/nvm/versions/node/v24.21.0/bin:/usr/bin:/bin [08:02:18.370] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:02:18.392] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:02:18.882] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'external', stateKey: 'e19b096f53873bed' } [08:02:19.255] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '44887:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 702159, localPort: 44887, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:44887/' } [08:02:19.256] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 44887, remotePort: 3774, remoteServerKind: 'external', issuedPairingToken: false } MANAGER_READY {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:44887/","wsBaseUrl":"ws://127.0.0.1:44887/","pairingToken":null,"remotePort":3774,"remoteServerKind":"external"} SERVER_PID: 698931 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: /tmp/ssh-r0SEDlyDHE/agent.702162 command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. DROP_TUNNEL 702159 [08:02:19.872] INFO (#1): ssh.environment.ensure.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, issuePairingToken: false } [08:02:21.886] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:44887/', requestUrl: 'http://127.0.0.1:44887/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:44887/.', cause: [Object] } } } [08:02:21.887] WARN (#1): ssh.environment.tunnel.existing.stale { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 44887, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } [08:02:21.889] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 44887, remotePort: 3774 } [08:02:21.890] INFO (#1): ssh.remoteServer.launch.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, runner: 'node-script', nodeScriptPath: '/home/ubuntu/wt/issue-11872/apps/server/src/bin.ts', stateKey: 'e19b096f53873bed' } [08:02:22.385] INFO (#1): ssh.remoteServer.launch.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, remotePort: 3774, remoteServerKind: 'external', stateKey: 'e19b096f53873bed' } [08:02:22.837] INFO (#1): ssh.tunnel.ready { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '41187', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-T', '-L', '35801:127.0.0.1:3774', '--', 't3issue11872@127.0.0.1', 'sh', '-l', '-s', '--', 'e19b096f53873bed' ], pid: 702961, localPort: 35801, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:35801/' } [08:02:22.838] INFO (#1): ssh.environment.ensure.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35801, remotePort: 3774, remoteServerKind: 'external', issuedPairingToken: false } MANAGER_RECONNECTED {"target":{"alias":"127.0.0.1","hostname":"127.0.0.1","username":"t3issue11872","port":41187},"httpBaseUrl":"http://127.0.0.1:35801/","wsBaseUrl":"ws://127.0.0.1:35801/","pairingToken":null,"remotePort":3774,"remoteServerKind":"external"} SERVER_PID: 698931 SERVER_SSH_AUTH_SOCK: /tmp/issue-11872-runtime/home/stable-agent.sock AGENT_LINK: /tmp/ssh-LG34Xxgcaw/agent.702970 command: test -S /tmp/issue-11872-runtime/home/stable-agent.sock exit: 0 command: ssh-add -l exit: 0 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) command: git -C /tmp/issue-11872-runtime/home/project fetch origin exit: 0 command: git -C /tmp/issue-11872-runtime/home/project pull exit: 0 Already up to date. [08:02:23.606] INFO (#1): ssh.environment.disconnect.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187 } [08:02:23.620] INFO (#1): ssh.tunnel.close.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187', localPort: 35801, remotePort: 3774 } [08:02:23.621] INFO (#1): ssh.remoteServer.stop.start { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:02:23.846] INFO (#1): ssh.remoteServer.stop.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, stateKey: 'e19b096f53873bed' } [08:02:23.846] INFO (#1): ssh.environment.disconnect.succeeded { alias: '127.0.0.1', hostname: '127.0.0.1', username: 't3issue11872', port: 41187, key: '127.0.0.1\x00127.0.0.1\x00t3issue11872\x0041187' } DISCONNECTED POST_DISCONNECT_SERVER: state=S pid= 698931 POST_DISCONNECT_AGENT_LINK: True live_socket= False MANAGER_EXIT=0 ===== agent-survival.log ===== 256 SHA256:06LdgyT53VENcFbPR7gEAYz2KHMtpjhTzqJPIYKMrjk ubuntu@fs-22 (ED25519) ===== cleanup-proof.txt ===== ssh_config restored=True home/.profile restored=True external.pid: gone stable-agent.pid: gone proof-local-agent.pid: gone parent sshd recorded PID exists=True tracked status= final HEAD=a96bd98149a3f5b444ba28e54489433816ac3b76 ===== red-test.log ===== note: You are running `vp test` as a Vite+ built-in command. If you meant to run the test npm script, use `vpr test` instead. RUN v5.0.5 /home/ubuntu/wt/issue-11872 stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:26.949] INFO (#1): ssh.environment.ensure.start { alias: 'devbox', hostname: 'devbox', username: null, port: null, issuePairingToken: false } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:27.019] INFO (#1): ssh.remoteServer.launch.start { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, runner: 'node-script', nodeScriptPath: '/tmp/t3-ssh-agent-FKIrKL/server.cjs', stateKey: '5e7a2aca2c020c38' } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:27.476] INFO (#1): ssh.remoteServer.launch.ready { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, remotePort: 3774, remoteServerKind: 'managed', stateKey: '5e7a2aca2c020c38' } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:27.489] INFO (#1): ssh.tunnel.ready { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '22', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '41800:127.0.0.1:3774', '--', 't3@devbox' ], pid: 605728, localPort: 41800, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:41800/' } [06:40:27.490] INFO (#1): ssh.environment.ensure.succeeded { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, key: 'devbox\x00devbox\x00t3\x0022', localPort: 41800, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:27.496] INFO (#1): ssh.environment.ensure.start { alias: 'devbox', hostname: 'devbox', username: null, port: null, issuePairingToken: false } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.542] WARN (#1): httpReadiness.timedOut { baseUrl: 'http://127.0.0.1:41800/', requestUrl: 'http://127.0.0.1:41800/', timeoutMs: 2000, intervalMs: 100, probeTimeoutMs: 1000, attempts: 20, lastFailure: { attempt: 20, cause: { _tag: 'SshReadinessError', message: 'Backend readiness probe failed at http://127.0.0.1:41800/.', cause: [Object] } } } [06:40:29.543] WARN (#1): ssh.environment.tunnel.existing.stale { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, key: 'devbox\x00devbox\x00t3\x0022', localPort: 41800, remotePort: 3774, cause: { _id: 'Cause', failures: [ [Object] ] } } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.549] INFO (#1): ssh.tunnel.close.succeeded { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, key: 'devbox\x00devbox\x00t3\x0022', localPort: 41800, remotePort: 3774 } [06:40:29.550] INFO (#1): ssh.remoteServer.launch.start { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, runner: 'node-script', nodeScriptPath: '/tmp/t3-ssh-agent-FKIrKL/server.cjs', stateKey: '5e7a2aca2c020c38' } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.821] INFO (#1): ssh.remoteServer.launch.ready { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, remotePort: 3774, remoteServerKind: 'managed', stateKey: '5e7a2aca2c020c38' } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.827] INFO (#1): ssh.tunnel.ready { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, command: [ 'ssh', '-o', 'BatchMode=no', '-o', 'ConnectTimeout=10', '-p', '22', '-o', 'ExitOnForwardFailure=yes', '-o', 'ControlMaster=no', '-o', 'ControlPath=none', '-o', 'ControlPersist=no', '-o', 'ServerAliveInterval=15', '-o', 'ServerAliveCountMax=3', '-n', '-N', '-L', '41801:127.0.0.1:3774', '--', 't3@devbox' ], pid: 606094, localPort: 41801, remotePort: 3774, httpBaseUrl: 'http://127.0.0.1:41801/' } [06:40:29.828] INFO (#1): ssh.environment.ensure.succeeded { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, key: 'devbox\x00devbox\x00t3\x0022', localPort: 41801, remotePort: 3774, remoteServerKind: 'managed', issuedPairingToken: false } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.834] INFO (#95): ssh.remoteServer.stop.start { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, stateKey: '5e7a2aca2c020c38' } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.986] INFO (#95): ssh.remoteServer.stop.succeeded { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, stateKey: '5e7a2aca2c020c38' } [06:40:29.987] INFO (#95): ssh.tunnel.close.succeeded { alias: 'devbox', hostname: 'devbox', username: 't3', port: 22, key: 'devbox\x00devbox\x00t3\x0022', localPort: 41801, remotePort: 3774 } stdout | packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect [06:40:29.998] ERROR (#1): Error [AssertionError]: managed server SSH_AUTH_SOCK=/tmp/t3-ssh-agent-FKIrKL/ssh-yObVNv/agent.605535: expected { sameServer: true, …(2) } to deeply equal { sameServer: true, …(2) } at /home/ubuntu/wt/issue-11872/packages/ssh/src/tunnel.test.ts:585:18 { actual: { sameServer: true, agentAfterLaunch: false, agentAfterReconnect: false }, expected: { sameServer: true, agentAfterLaunch: true, agentAfterReconnect: true }, showDiff: true, operator: 'deepStrictEqual', [cause]: undefined } ❯ |root| packages/ssh/src/tunnel.test.ts (9 tests | 1 failed | 7 skipped) 3683ms ❯ managed server forwarded agent (2) × keeps the forwarded agent reachable from the managed server while connected and across reconnect 3070ms ⎯⎯⎯⎯⎯⎯⎯ Failed Tests 1 ⎯⎯⎯⎯⎯⎯⎯ FAIL |root| packages/ssh/src/tunnel.test.ts > managed server forwarded agent > keeps the forwarded agent reachable from the managed server while connected and across reconnect AssertionError: managed server SSH_AUTH_SOCK=/tmp/t3-ssh-agent-FKIrKL/ssh-yObVNv/agent.605535: expected { sameServer: true, …(2) } to deeply equal { sameServer: true, …(2) } - Expected + Received { - "agentAfterLaunch": true, - "agentAfterReconnect": true, + "agentAfterLaunch": false, + "agentAfterReconnect": false, "sameServer": true, } ❯ packages/ssh/src/tunnel.test.ts:585:18 583| 584| assert.notEqual(second.httpBaseUrl, first.httpBaseUrl); 585| assert.deepEqual( | ^ 586| { 587| sameServer: reused.pid === launched.pid, ❯ ~effect/Effect/successCont node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/effect.ts:1422:28 ❯ ~effect/Effect/evaluate node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/core.ts:585:30 ❯ FiberImpl.runLoop node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/effect.ts:654:41 ❯ FiberImpl.evaluate node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/effect.ts:595:23 ❯ FiberImpl.evaluate node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/effect.ts:589:27 ❯ node_modules/.pnpm/effect@4.0.5/node_modules/effect/src/internal/effect.ts:1159:17 ❯ Socket. packages/ssh/src/tunnel.test.ts:457:32 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/1]⎯ Test Files 1 failed (1) Tests 1 failed | 1 passed | 7 skipped (9) Start at 06:40:20 Duration 9.83s (transform 41%, tests 38%, setup 16%, import 4%) ===== green-tests.log ===== note: You are running `vp test` as a Vite+ built-in command. If you meant to run the test npm script, use `vpr test` instead. RUN v5.0.5 /home/ubuntu/wt/issue-11872 Test Files 4 passed (4) Tests 22 passed (22) Start at 06:48:22 Duration 21.98s (transform 43%, tests 35%, import 12%, setup 10%)