Open
Description
IcebergDataSource currently builds TableScan without forwarding read-ahead configuration. apache/iceberg-rust#3395 adds the underlying TableScanBuilder methods.
Expose optional footer metadata size hints and range-coalescing gap settings through the DataFusion integration. Preserve existing behavior when unset, and support both static and catalog-backed table providers.
Tests should verify actual storage byte ranges and unchanged query results with page pruning disabled, including a merged request larger than the configured gap.
This proposes configurable controls without changing defaults. It depends on apache/iceberg-rust#3395 landing and updating the integration’s pinned Iceberg revision. I’m willing to implement this.
Metadata
Metadata
Assignees
Labels
No labels
Activity
terbed commentedon Oct 11, 2026
This would look like something as follows:
Once the extension is registered, the same settings can be changed through SQL:
Both fields default to
None, preserving Iceberg’s existing reader defaults. Explicit values would be forwarded through the common scan path, covering both static and catalog-backed table providers.