Skip to content

Public API

Raul Cardenas Montoya edited this page Sep 17, 2026 · 3 revisions

Public API

Wiki hero

Re-exported from crate root (src/lib.rs):

Symbol Module Gate
load_gguf, parse_bytes gguf
GgufLayout, GgufMetadata gguf
Tensor, DType gguf
f16_bits_to_f32 gguf
dequantize_q8_0, dequantize_q5_k, dequantize_q6_k, dequantize_iq3_m, dequantize_packed gguf
ggml_type_label, packed_row_size gguf
load_gguf_mmap, GgufLayoutMmap, PageAlignedTensorBytes, os_page_size gguf --features mmap
extract_expert, list_experts moe
MoeExpertWeights, RawTensor moe
inspect_safetensors_checkpoint, SafetensorsManifest, SafetensorsCheckpointSource, SafetensorsTensorRecord, write_safetensors_manifest safetensors --features safetensors
discover_candidates, classify_tensor, SafetensorsCandidateSummary, SafetensorsRouterCandidate, SafetensorsExpertGroup safetensors --features safetensors
dtype_size_bytes, INDEX_UNREFERENCED_SHARDS_KEY safetensors --features safetensors
ParserError, Result error

Also: pub mod error, gguf, moe, and (feature-gated) safetensors.

GGML type constants (GGML_TYPE_*) are public on the gguf path for dtype mapping.


Last updated: September 16, 2026 Updated by: KAI Package tip reference: 3dea2c3 (main)

Clone this wiki locally