Skip to content

[Skills] Add evals and skill cards for kernel authoring and trace analysis - #1304

Merged
coderfeli merged 3 commits into
ROCm:mainfrom
danielholanda:skills/evals-and-cards
Oct 18, 2026
Merged

coderfeli merged 3 commits into
ROCm:mainfrom
danielholanda:skills/evals-and-cards

Conversation

@danielholanda

@danielholanda danielholanda commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

Description

This PR:

  • Adds evals/ + skill-card.md for kernel authoring and trace analysis skills
  • Adds skill-evals.yml‎
    • This enables you to run exactly the same tests we run at AMD/skills
    • "Structural" tests don't require any agents to run (check for file sizes, broken links, etc)
    • "Behavioral" and "Routing" tests require LLM access, but only run when manually dispatched

Note: Merging #1305 should make all structural tests pass

@danielholanda danielholanda changed the title [Skills] Add evals, skill cards, and skillscope CI for kernel authoring and trace analysis [Skills] Add evals and skill cards Oct 16, 2026
…lysis

Co-authored-by: Felix Li <felix.li@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@danielholanda
danielholanda force-pushed the skills/evals-and-cards branch from c28f67b to d2d44b7 Compare October 16, 2026 17:28
@danielholanda danielholanda changed the title [Skills] Add evals and skill cards [Skills] Add evals and skill cards for kernel authoring and trace analysis Oct 16, 2026
Co-authored-by: Cursor <cursoragent@cursor.com>
@danielholanda
danielholanda force-pushed the skills/evals-and-cards branch from b2f5b13 to 88e032f Compare October 16, 2026 20:09
@@ -0,0 +1,52 @@
{

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a lot of content on ‎fixtures/offline. You can potentially avoid having those files here by writing something like "fetch the fixes from http://..." to evals.json.

@coderfeli
coderfeli merged commit 410b0ae into ROCm:main Oct 18, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants