Skip to content

Add streaming CPU CD refits and memory-bounded QC - #16

Open
JerryIshihara wants to merge 1 commit into
TrynkaLab:mainfrom
JerryIshihara:features/RAM-safe-dense-matrix-refit
Open

JerryIshihara wants to merge 1 commit into
TrynkaLab:mainfrom
JerryIshihara:features/RAM-safe-dense-matrix-refit

Conversation

@JerryIshihara

@JerryIshihara JerryIshihara commented Oct 15, 2026 •

Copy link
Copy Markdown

Changes:

  • Add optional --streaming consensus refits using FP64 CPU CD.
  • Stream usage fitting and full-gene spectra calculations.
  • Automatically size chunks against a shared 16 GiB working-memory budget.
  • Use four chunk workers with four BLAS threads each.
  • Calculate QC R²/SSE/TSS without constructing the full reconstruction matrix.

Roadmap

Refs JerryIshihara/sc-blipper#28. This PR implements streaming refits and optional streamed QC; remaining end-to-end RAM-safety work is tracked in the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant