Skip to content

Milestone 4B: retrieval result cleanup - #2

Merged
princerm06 merged 5 commits into
mainfrom
milestone-4b-retrieval-cleanup
Oct 5, 2026
Merged

princerm06 merged 5 commits into
mainfrom
milestone-4b-retrieval-cleanup

Conversation

@princerm06

Copy link
Copy Markdown
Owner

Summary

  • deduplicate semantic search results by source page while retaining the strongest matching chunk
  • fetch a wider candidate pool so duplicate chunks do not reduce the number of unique sources returned
  • replace raw chunk payloads with compact, whitespace-normalized excerpts
  • expose clearer matched-chunk provenance fields in the search API
  • simplify frontend result cards so chunk debugging metadata is no longer user-facing
  • add retrieval formatting/deduplication unit tests
  • extend backend CI to run both chunking and retrieval tests

Safety / scope

  • no database schema changes
  • no migrations
  • no deployment changes
  • no secrets or external services added
  • main remains unchanged until this PR is verified and merged

Verification

GitHub Actions should run the backend unit-test suite automatically on this PR. Leave this PR unmerged until CI is green and the behavior is reviewed.

@princerm06
princerm06 marked this pull request as ready for review October 5, 2026 09:04
@princerm06
princerm06 merged commit b118ad4 into main Oct 5, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant