[devin-ai-integration]

Summary

Automates qa/manual-test-plan.csv as Playwright tests (Chromium) that run in GitHub Actions against a real MySQL 8 service. Adds a coverage matrix that accounts for all 60 rows.

• 54 rows automated, one test per row, titled MT-0xx <plan title> (e2e/tests/*.spec.ts). All 54 pass locally against MySQL 8.0 (two back-to-back runs on the same DB, no reset in between).
• 6 rows not automated, each with a reason in qa/not-automated.json:
  • MT-021: brand-team sign-off
  • MT-047: expected result is "System handles it appropriately", which isn't a testable pass condition, so no assertion was made up for it
  • MT-048: no SMS/email feature exists
  • MT-055: physical printer
  • MT-059: JAWS
  • MT-060: moderated usability session
• qa/coverage-matrix.md is generated by e2e/scripts/coverage-matrix.mjs from the plan, the specs, not-automated.json and Playwright's JSON results. CI publishes it to the job summary and the e2e-report artifact, together with the HTML report and app.log.
• npm run matrix:check runs before the build and fails if any row is unaccounted for, listed in both places, has two tests, or refers to an ID that isn't in the plan. I checked this by dropping MT-021 from not-automated.json: it exits 1.

MT-047 finding (needs a product decision). On this build, POST /transfer amount=-50 is accepted: the sender's balance goes up by 50, the recipient's goes down by 50, and the sender's history logs "Transfer Out to ". The amount <input type=number> has no min, and AccountService.transferAmount doesn't check the sign. The suite doesn't assert anything for this row until the plan defines the expected behavior.

CI notes:

• Uses mirror.gcr.io/library/mysql:8.0 and demo/maven-settings.xml, per AGENTS.md.
• The job checks that the server version is 8.x.
• Each test registers its own unique users, so the suite runs in parallel and doesn't need a clean database.
• The dashboard panels load Bootstrap from public CDNs, so the runner needs internet access.

Heads-up: demo/setup-demo.sh ends with a "BEFORE state" guard (e2e/ must not exist), so it will report SETUP FAILED on this branch after the app is already up. That's expected for the demo seed and nothing in this PR changes it.

Link to Devin session: https://devin-gtm.devinenterprise.com/sessions/4e5ce8a64e094b30882fb37f4f9983c5
Open in Devin Desktop: https://devin-gtm.devinenterprise.com/desktop/session/4e5ce8a64e094b30882fb37f4f9983c5?variant=devin
Requested by: @GarretAnd

---

Devin Review

Status	Commit
⚪ Not started	—

Run Devin Review

Enable auto-review to review your pull requests automatically.

---

[devin-ai-integration]

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

• Disable automatic comment, CI, and merge conflict monitoring

[devin-ai-integration]

Closed by demo/seed-situation.sh: demo_qa seed branch was reset.