Skip to content

[metrics] Add totalFileCount and minAvgFileSize metrics to detect small file problem - #9449

Open
junmuz wants to merge 1 commit into
apache:masterfrom
junmuz:feature/small-files-metrics
Open

[metrics] Add totalFileCount and minAvgFileSize metrics to detect small file problem#9449
junmuz wants to merge 1 commit into
apache:masterfrom
junmuz:feature/small-files-metrics

Conversation

@junmuz

@junmuz junmuz commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Purpose

  • Adds totalFileCount metric to track the total number of data files across all levels
  • Adds minAvgFileSize metric to surface when average file size drops below a healthy threshold
  • These metrics help detect the small file problem early, enabling proactive compaction tuning

Tests

  • Unit test added in CompactionMetricsTest
  • Documentation updated in docs/maintenance/metrics.md

@JingsongLi JingsongLi closed this Aug 28, 2026
@JingsongLi JingsongLi reopened this Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants