Skip to content

[core] Support FM indexes for primary-key tables - #9447

Merged
JingsongLi merged 3 commits into
apache:masterfrom
JingsongLi:codex/pk-fm-index
Aug 28, 2026
Merged

[core] Support FM indexes for primary-key tables#9447
JingsongLi merged 3 commits into
apache:masterfrom
JingsongLi:codex/pk-fm-index

Conversation

@JingsongLi

@JingsongLi JingsongLi commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Purpose

Support exact FM contains indexes for primary-key tables and document FM index usage.

Changes

  • add PK FM configuration, validation, schema guards, and query routing
  • build FM payloads in source-row order and append bounded partitions to one checksummed container file
  • keep one payload file and one IndexFileMeta per index group while preserving partition-level demand reads
  • add exact Contains coverage for partial index states, short needles, Unicode, updates, and deletes
  • add FM documentation under docs/docs and the documentation sidebar

Tests

  • 24 focused FM format and query tests
  • 132 focused paimon-core tests
  • 4 Spark 3 PrimaryKeySortedIndexTest cases
  • paimon-core non-fast compile/checkstyle/spotless/enforcer
  • docs sidebar syntax check

@JingsongLi
JingsongLi merged commit f01570c into apache:master Aug 28, 2026
3 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants