Skip to content

[FEAT]: Serialize final evaluation metadata - #147

Draft
spencrr wants to merge 3 commits into
microsoft:mainfrom
spencrr:dev/spencrr/trace-serialization
Draft

[FEAT]: Serialize final evaluation metadata#147
spencrr wants to merge 3 commits into
microsoft:mainfrom
spencrr:dev/spencrr/trace-serialization

Conversation

@spencrr

@spencrr spencrr commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

Description

Carries final evaluation evidence, trace termination reason, and turn evaluation role through the existing xdist v1 transport and the built-in JSON report projection.

Core semantic enums remain fail-closed. Additive display enums warn and deserialize to None when a remote worker uses an unknown value. Workers also include their installed package version for skew diagnostics. Old v1 payloads remain valid, and final evaluator text uses the existing ANSI-stripping and size-limit path.

Depends on #146. Because the branches live on a fork, this PR temporarily includes lower-layer diffs and targets main; those diffs disappear as dependencies merge.

Breaking changes

None. The xdist schema remains rampart.xdist.v1; all new fields are optional and additive.

Checklist

  • pre-commit run --all-files passes
  • Tests added for round trips, old payloads, unknown fields and enum values, sanitization, confidence handling, and version diagnostics
  • Documentation updated

Validation: 122 serialization, aggregation, and report tests pass, strict documentation build passes, and static checks pass.

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
There may be pipelines that require an authorized user to comment /azp run to run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant