Skip to content

Keep HF cuFile/hipFile weights on device when memory permits - #2

Merged
cyyever merged 1 commit into
trimfrom
perf/hf-direct-device-load
Oct 22, 2026
Merged

cyyever merged 1 commit into
trimfrom
perf/hf-direct-device-load

Keep HF direct-storage weights on device when memory permits

71b1a8d
Select commit
Loading
Failed to load commit list.