Skip to content

[format] Fix ORC zstd compression option inconsistent across writers - #9453

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/jvm-zstd-bug
Open

[format] Fix ORC zstd compression option inconsistent across writers#9453
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/jvm-zstd-bug

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Multiple ORC writers on same JVM share the options. When writers use different compression settings, one writer overwrites the settings used by another.
  • Paimon applies each writer’s compression level and window size directly to the shared defaults, making the resulting compression depend on writer creation order.
  • Ensure each writer gets it's own copy

Tests

  • UT

@JingsongLi JingsongLi closed this Aug 28, 2026
@JingsongLi JingsongLi reopened this Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants