Skip to content

Project Structure

Raul Cardenas Montoya edited this page Sep 17, 2026 · 3 revisions

Project Structure

Wiki hero

engram-parser/
├── src/
│   ├── lib.rs                 # re-exports
│   ├── error.rs               # ParserError (hand-rolled)
│   ├── gguf/
│   │   ├── mod.rs             # load_gguf, parse_bytes (+ mmap re-exports)
│   │   ├── cursor.rs          # LE streaming reads, KV skip
│   │   ├── layout.rs          # GgufLayout, GgufMetadata, parse_layout
│   │   ├── tensor.rs          # Tensor, DType, f16 helper
│   │   ├── dequant.rs         # packed dequant: Q8_0 / Q5_K / Q6_K / IQ3_M
│   │   └── map.rs             # load_gguf_mmap (--features mmap)
│   ├── moe/
│   │   ├── mod.rs
│   │   ├── expert.rs          # MoeExpertWeights, RawTensor
│   │   └── extract.rs         # list_experts, extract_expert
│   └── safetensors/           # --features safetensors (zero extra crates)
│       ├── mod.rs             # inspect_safetensors_checkpoint, re-exports
│       ├── discovery.rs       # MoE candidate discovery + classify_tensor
│       ├── json.rs            # in-crate JSON (no serde_json)
│       ├── manifest.rs        # SafetensorsManifest, deterministic manifests
│       ├── paths.rs           # checkpoint-relative shard resolution
│       └── validate.rs        # reusable validation, dtype_size_bytes
├── tests/
│   ├── gguf_smoke.rs          # synthetic GGUF e2e
│   ├── safetensors_smoke.rs   # safetensors feature smoke
│   ├── mmap_gguf.rs           # mmap reader tests
│   └── real_gguf.rs           # path-gated real-file pilots (ignored in CI)
├── examples/
│   └── inspect_gguf.rs
├── .github/workflows/
│   ├── ci.yml
│   ├── docker-build.yml
│   ├── release.yml
│   └── security.yml
├── Dockerfile
├── Cargo.toml                 # default [dependencies] empty; optional memmap2
└── README.md

Crate metadata

Field Value
name engram-parser
version 0.2.0
edition 2024
rust-version (MSRV) 1.97.1
default dependencies none
optional dependency memmap2 (only under --features mmap)
features safetensors (zero-dep), mmap
release opt-level=3, LTO, codegen-units=1

Standalone [workspace] so parent workspaces do not absorb the crate.


Last updated: September 16, 2026 Updated by: KAI Package tip reference: 3dea2c3 (main)

Clone this wiki locally