test(verification): separate semantic fixtures from deadline boundaries - #222
metaphorics wants to merge 2 commits into
Conversation
…into stabilize/test262-fixture-deadlines
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Advanced Run ID: 📒 Files selected for processing (1)
Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review. 📜 Recent review details⏰ Context from checks skipped due to timeout. (3)
🔇 Additional comments (1)
📝 SummarySummary by CodeRabbit
WalkthroughTest262 semantic fixtures now use a 10-second deadline instead of the 500ms async deadline. A new test verifies exact, error, and one-nanosecond-late completion behavior. ChangesDeadline handling
Priority: ⬇️ Low Change: Other 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches 💡 1🛠️ Fix failing CI checks 💡
✨ Simplify code
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
There was a problem hiding this comment.
The changes correctly separate semantic test fixture deadlines from production timeout boundaries. The new SEMANTIC_FIXTURE_DEADLINE constant (10 seconds) gives test fixtures adequate budget under parallel CI load while preserving the production DEFAULT_ASYNC_DEADLINE at 500ms. The added test production_done_deadline_boundary_remains_exact() validates that production deadline behavior remains unchanged, verifying acceptance at exactly 500ms and rejection at 500ms + 1 nanosecond. No issues found that would block merge.
You can now have the agent implement changes and create commits directly on your pull request's source branch. Simply comment with /q followed by your request in natural language to ask the agent to make changes.
Change
Keep real-engine Test262 completion/error fixtures independent of host scheduling jitter by giving only the test helper a finite 10-second budget. Production DEFAULT_ASYNC_DEADLINE remains 500 ms. Add deterministic success/error checks exactly at that boundary and one nanosecond after it.
Evidence
The earlier full-workspace run reproduced two semantic fixtures reporting Done(Late) instead of the expected completion/error result under parallel load. After the change, the fresh pinned-toolchain run of
cargo test --workspace --lib --lockedpassed 4,397 tests, with zero failures and four existing ignored tests. This includes all 697 verification-library tests and the real interpreter fixtures.The synchronized stack also passed all 58 real-process CLI E2E tests, including pinned TypeScript 7.0.2 / Node 24.18.0 differential workloads, eight deterministic arithmetic seeds, malformed-frame recovery, backpressure, and watchdog coverage.
Stack
Depends on #221. That PR contains the real TypeScript/chaos suite and the Windows oracle provisioning fix. This PR changes only Test262 test code; it does not relax a production timeout, an authority gate, or a receipt requirement. Root product completion and Windows release validation are not claimed.