Skip to content

Catalog: add Muse Glimmer 30B, and a gptq-4bit board for Nemotron 3.5 Lightning - #31

Merged
jackwsmth merged 2 commits into
labscommunity:mainfrom
SergiioB:catalog-nemotron-gptq-muse
Sep 18, 2026
Merged

jackwsmth merged 2 commits into
labscommunity:mainfrom
SergiioB:catalog-nemotron-gptq-muse

Conversation

@SergiioB

Copy link
Copy Markdown
Contributor

What changes (one file, three additions)

  1. New model — Muse Glimmer 30B (muse-glimmer-30b): Meta's dense 30B, source facebook/Muse-Glimmer-30B. Board: q4_k_xl only — the one format actually run in the wild (Unsloth Dynamic GGUF), per the "list only the ones people actually run" rule. No logo: monogram tile is fine.
  2. New quant id — q4_k_xl: GGUF, Unsloth Dynamic Q4_K_XL. Deliberately not folded into q4_k_m: a dynamic Q4_K_XL artifact is a different weight layout than a stock Q4_K_M, and the boards are per-quantization.
  3. Nemotron 3.5 Lightning 30B A3B gains gptq-4bit on its board — the GPTQ-INT4 G64 checkpoint its vLLM results run on has no board today. gptq-4bit already exists in QUANTS and is already used this way by the Qwen3.5 boards (int4 = OpenVINO/IPEX weight-only, gptq-4bit = GPTQ), so this follows the established taxonomy instead of stretching int4.

Why these, and not more

  • Ornith-1.5-35B-A3B deliberately excluded. I measured it (GPTQ + AutoRound W4A16 A/B), but closed the route on quality grounds and removed the artifacts — there is no clean public checkpoint path worth a leaderboard. autoround therefore also stays out of QUANTS for now: no live results need it.
  • No awq changes — the id exists and qwen3-6-27b already carries an awq-4bit board; nothing to add.
  • Total diff: +6/−1 lines, one file.

Unblocks measured results

Once merged, I'll submit two held-back n=5 results that currently have no valid boards: Nemotron 3.5 Lightning DFlash n7 (186.61 tok/s, vLLM, gptq-4bit) and Muse Glimmer 30B DFlash n2 (26.8 tok/s, llama.cpp, q4_k_xl). Both measured on one Arc Pro B70 with full coordinates.

Verification

  • npm run catalog:validate: ✅ 46 hardware, 32 models, 15 quants, 7 runtimes.
  • npm run typecheck and npm run build: ✅.

Three catalog additions, each tied to a measured result waiting to be
submitted:

- Muse Glimmer 30B (facebook/Muse-Glimmer-30B, dense 30B) with a
  q4_k_xl board, plus the matching QUANTS entry: Unsloth Dynamic
  Q4_K_XL is a distinct artifact class from Q4_K_M and gets its own
  board instead of being folded into one.
- Nemotron 3.5 Lightning 30B A3B gains a gptq-4bit board for the
  GPTQ-INT4 G64 checkpoint its vLLM results run on, matching how the
  Qwen3.5 boards separate gptq-4bit from int4.
@vercel

vercel Bot commented Sep 17, 2026

Copy link
Copy Markdown

@SergiioB is attempting to deploy a commit to the Community Labs Team on Vercel.

A member of the Team first needs to authorize it.

@github-actions

github-actions Bot commented Sep 17, 2026

Copy link
Copy Markdown
No result files to import.

Site / sign up · Workflow details and retry

@vercel

vercel Bot commented Sep 18, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
intelinside Ready Ready Preview Sep 18, 2026 3:40am UTC

Request Review

@jackwsmth
jackwsmth merged commit 6dc41aa into labscommunity:main Sep 18, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants