Skip to content

Bcal/dataset panels - #965

Open
martinsrui-msft wants to merge 2 commits into
mainfrom
bcal/dataset-panels
Open

martinsrui-msft wants to merge 2 commits into
mainfrom
bcal/dataset-panels

Conversation

@martinsrui-msft

Copy link
Copy Markdown
Collaborator

No description provided.

martinsrui-msft and others added 2 commits October 9, 2026 15:36
Import reviewed gold and challenge panels, preserve supported native multi-turn scenarios, and carry dataset/model/package identity into evaluation metadata. Keep latest installation per matrix job and support exact NuGet pins.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Compare produced result IDs with the selected workflow matrix, retain coverage diagnostics, and block scoring uploads when cases are missing, unexpected or duplicated.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@github-code-quality

Copy link
Copy Markdown
Contributor

Code Coverage Overview

Languages: Python

Python / code-coverage/pytest

The overall line coverage in commit 443bc48 in the bcal/dataset-panels branch is 88%. The line coverage in commit c84b793 in the main branch is 87%.

Show a line coverage summary of the most impacted files.
File main c84b793 bcal/dataset-panels 443bc48 +/-
src/bcbench/commands/run.py 89% 82% -7%
src/bcbench/res...ceval_export.py 100% 95% -5%
src/bcbench/commands/result.py 93% 89% -4%
src/bcbench/dat...ataset_entry.py 94% 95% +1%
src/bcbench/results/base.py 94% 95% +1%
src/bcbench/com...nds/evaluate.py 77% 78% +1%
src/bcbench/age...t/bcal/agent.py 86% 89% +3%
src/bcbench/com...ands/dataset.py 25% 56% +31%
src/bcbench/age...cal/scenario.py 0% 100% +100%
src/bcbench/age...bcal/version.py 0% 100% +100%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant