Skip to content

Measure project retrieval and real task token usage - #5

Merged
Zulut30 merged 2 commits into
mainfrom
codex/token-efficiency-pilot-20260924
Sep 24, 2026
Merged

Zulut30 merged 2 commits into
mainfrom
codex/token-efficiency-pilot-20260924

Conversation

@Zulut30

@Zulut30 Zulut30 commented Sep 24, 2026

Copy link
Copy Markdown
Member

Project-owned retrieval manifests now measure six real-code queries and one no-answer query per project, with case filtering for bounded OpenRouter runs. The CLI also reports daily cache activity and resolves the exact current Codex session for task metering. Stable query-term ordering prevents Python hash seeds from changing lexical scores and semantic cache keys.

Validation: make verify passed with pinned quality dependencies; local project manifests found all 12 positive targets within top three and correctly rejected both no-answer cases. The expanded semantic run reached the shared 24-hour call cap, so no complete remote score or task-savings claim is made.

@Zulut30
Zulut30 merged commit d430c84 into main Sep 24, 2026
2 checks passed
@Zulut30
Zulut30 deleted the codex/token-efficiency-pilot-20260924 branch October 21, 2026 20:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant