Skip to content

05: Lint script for autopilot prompt drift detection #52

Description

@MatthewYe

Parent

#47

What to build

实现 scripts/lint-autopilot.ts,通过 LLM 检测两份 autopilot prompt 产物之间的漂移:

  1. 读取 packages/opencode/commands/autopilot.mdpackages/codex/skills/autopilot/SKILL.md
  2. 构造 prompt 发给 LLM,要求对比 shared 逻辑的一致性
  3. LLM 输出结构化 JSON drift report:
[{
  "section": "Phase 1: Dispatch Loop - Retry count",
  "opencode_behavior": "max 3 rounds...",
  "codex_behavior": "max 3 rounds...",
  "drift_severity": "none|minor|major|critical",
  "recommendation": "..."
}]
  1. 汇总输出到 stdout

Acceptance criteria

  • bun run lint:autopilot 运行 lint
  • 对 aligned 的 prompt 输出 no drift
  • 对人为制造差异的 prompt 能检测并报告
  • 输出格式为结构化 JSON

Blocked by

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    resolvedAutopilot has resolved this issue

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions