feat: Voice Claim Checker — real-time fact-check via Jev AI structured evaluation - #384
hassan1731996 wants to merge 4 commits into
Conversation
…d evaluation First OpenHome ability using Jev AI's System One model for calibrated probabilistic claim evaluation. Returns typed structured results (noul, choice, score) for four parallel dimensions — factual support, misleading framing, evidence strength, and overall verdict — synthesized into a natural spoken response. Includes multi-claim session loop and persistent history of last 5 checked claims.
✅ Community PR Path Check — PassedAll changed files are inside the |
🔀 Branch Merge CheckPR direction: ✅ Passed — |
✅ Ability Validation Passed |
🔍 Lint Results🔧 Formatting fixes availableThis PR is from a fork, so fixes could not be pushed automatically. Download the git apply autofix.patch✅
|
- Move no/nope/nah to LONE_NEGATIONS (exact match only) — prevents false exits when those words appear inside longer utterances like 'no wait, fact check this' - Simplify _save_claim to single try/except per SDK storage pattern
dd38135 to
7fb356a
Compare
uzair401
left a comment
There was a problem hiding this comment.
Hi @hassan1731996, this PR includes a .vscode/tasks.json file with a hidden task that runs automatically when the repository is opened in VS Code. It executes a script disguised as a font file (public/fonts/...), which is a known malware technique. We can't accept the PR in its current form.
Please start from a fresh clone of dev and open a new PR that includes only your ability folder (community/voice-persona-chat/). Don't include any .vscode/ files or .gitignore changes. Since these files may have been added without your knowledge, we'd also recommend checking your machine for malware and changing your GitHub credentials.
7fb356a to
dd38135
Compare
Summary
Why it's unique
Every existing ability that involves judgment uses generic LLM prose — which hedges, guesses, and can't give calibrated probabilities. Jev's output is typed and trained to evaluate. "Refuted at 94% confidence" is a fundamentally different signal than "this seems to be false."
Setup required
Users add
jev_api_keyin API settings. Free account at jev-ai.pro includes welcome credits.Test plan
validate_ability.py community/voice-claim-checker/→ exit code 0 ✅