Skip to content

fix: report failed CLI provider probes with nonzero status - #32

Closed
xiehuanyi wants to merge 1 commit into
cased:mainfrom
xiehuanyi:fix/provider-test-exit-status
Closed

xiehuanyi wants to merge 1 commit into
cased:mainfrom
xiehuanyi:fix/provider-test-exit-status

Conversation

@xiehuanyi

Copy link
Copy Markdown

The sandbox test command currently prints a provider as Working and exits successfully even when its probe command fails or returns unexpected output. Failed sandbox cleanup is also printed as successful.

Track probe and cleanup failures, report them in the summary, and return a nonzero status while continuing to test the remaining providers. Successful probes retain exit status zero.

Validation: the regression tests fail on current main (three failures, one passing control) and all four pass after this change. The 31 CLI tests and 212 offline tests pass; one live-credential test is skipped and 30 integration tests are deselected. Ruff and Black pass. Mypy remains advisory in the repository workflow and reports the same existing 57 diagnostics. No cloud calls were made.

Copilot AI balanced review requested due to automatic review settings October 6, 2026 18:55

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@xiehuanyi xiehuanyi closed this Oct 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants