fix(test): budget Pi helper startup independently - #643
Conversation
monit-reviewer
left a comment
There was a problem hiding this comment.
Automated PR Review
Reviewed commit: 8b77132f935d
Profile: codex-monit-reviewer - Posting as: monit-reviewer
Summary
| Reviewer | Findings |
|---|---|
| go:implementation-tests | 0 |
Reviewer Coverage
go:implementation-tests— complete (broad); skipped: none; constraints: Review scoped to the assigned test and controls, with nearby extension and process helpers inspected. Validated on macOS with CGO_ENABLED=0: three normal runs and the slow-start control passed; the detached-helper control failed the process-group assertion as intended. Default CGO build was blocked by a compiler cache path error; Linux and race runs were not performed.
Inspected files (3)
internal/llmadapters/pi_rpc_extension_unix_test.gointernal/llmadapters/testdata/pi_rpc_detached_helper.cjsinternal/llmadapters/testdata/pi_rpc_slow_start.cjs
0 PR discussion threads considered. 0 summarized; 0 resolved.
Completed in 2m 04s | gpt-6.1-sol | cr 0.10.319
| Field | Value |
|---|---|
| Model | gpt-6.1-sol |
| Reviewers | go:implementation-tests |
| Engine | codex_cli · gpt-6.1-sol |
| Reviewed by | cr · monit-reviewer |
| Duration | 2m 04s wall · 1m 51s compute |
| Cost | unavailable |
| Tokens | 493.6k in / 1.8k out |
Per-workstream usage
orchestrator-selection— gpt-6.1-sol- In: 79.6k
- Out: 316
- Cache read: 59.0k
- Cache create: unavailable
- Cost: unavailable
- Duration: 25s
go:implementation-tests— gpt-6.1-sol- In: 298.1k
- Out: 1.1k
- Cache read: 272.5k
- Cache create: unavailable
- Cost: unavailable
- Duration: 1m 18s
orchestrator-rollup— gpt-6.1-sol- In: 115.8k
- Out: 389
- Cache read: 91.4k
- Cache create: unavailable
- Cost: unavailable
- Duration: 7s
monit-reviewer
left a comment
There was a problem hiding this comment.
Automated PR Review
Reviewed commit: a4966103b244
Profile: codex-monit-reviewer - Posting as: monit-reviewer
Summary
| Reviewer | Findings |
|---|---|
| go:implementation-tests | 0 |
Reviewer Coverage
go:implementation-tests— complete (constrained); skipped: none; constraints: Read-only sandbox prevented running tests that create build artifacts and temporary scripts. Prior-run validation was not treated as execution evidence for this head. Review scoped to the assigned files and nearby extension, polling, and process-existence helpers.
Inspected files (3)
internal/llmadapters/pi_rpc_extension_unix_test.gointernal/llmadapters/testdata/pi_rpc_detached_helper.cjsinternal/llmadapters/testdata/pi_rpc_slow_start.cjs
0 PR discussion threads considered. 0 summarized; 0 resolved.
Completed in 1m 10s | gpt-6.1-sol | cr 0.10.319
| Field | Value |
|---|---|
| Model | gpt-6.1-sol |
| Reviewers | go:implementation-tests |
| Engine | codex_cli · gpt-6.1-sol |
| Reviewed by | cr · monit-reviewer |
| Duration | 1m 10s wall · 57s compute |
| Cost | unavailable |
| Tokens | 602.1k in / 2.0k out |
Per-workstream usage
go:implementation-tests— gpt-6.1-sol- In: 447.1k
- Out: 1.6k
- Cache read: 402.9k
- Cache create: unavailable
- Cost: unavailable
- Duration: 50s
orchestrator-rollup— gpt-6.1-sol- In: 155.0k
- Out: 456
- Cache read: 127.5k
- Cache create: unavailable
- Cost: unavailable
- Duration: 6s
|
Post-merge verification: v0.10.322 points to merge commit
Historical failed runs are unchanged. This verification uses the new merged commit and release. It does not claim a live Pi/provider integration result or resolve compatibility of older installed Pi versions. |
Summary
Give the Pi process-group test a bounded startup budget for both Node processes. Keep the helper's five-second runtime timeout and the cleanup assertion unchanged, and explicitly verify that the helper belongs to the runner's process group.
Capture runner diagnostics on failure, report helper tool errors, and wait for a complete positive PID rather than merely the existence of its file. No production adapter or Pi compatibility flags change. This does not overlap the settlement/accounting changes in #641.
Evidence
timeoutstop acknowledgement and stream duration); the focused Pi race repeats pass. Both actual GitHub CI test jobs passed on the initial PR head.Re-run the normal test:
For the slow-start control, set
NODE_OPTIONSto--requireplus the absolute path ofinternal/llmadapters/testdata/pi_rpc_slow_start.cjs; the test should pass. Withpi_rpc_detached_helper.cjsinstead, it must fail the process-group assertion. These controls are test-only and must not be used for normal CLI execution.The locally installed Pi 0.68.1 does not support the required reviewer isolation flags. This PR does not weaken those controls or claim to fix that separate runtime compatibility gap. Linux verification of the generated extension is not a real Pi/provider integration result.