Issues

• compiling main with ROCm 7.2 fails

  microsoft/VPTQ#204 · Filter by author akostadinov opened on Mar 20, 2026

• Is the accuracy reported in the paper the result with finetuning applied?

  microsoft/VPTQ#203 · Filter by author jiwonchoi99 opened on Mar 12, 2026

• Large PPL Fluctuations in VPTQ 4.05-bit Quantization Despite Fixed Random Seed and Identical Setup

  microsoft/VPTQ#202 · Filter by author Qingtian-Liu opened on Nov 13, 2025

• "ValueError: Expected 1 columns but got 8 columns." when quantizing Llama3.2-1B

  microsoft/VPTQ#201 · Filter by author SunXT-0719 opened on Oct 21, 2025
  9

• How does the inference speed of VPTQ-3bit compare to AWQ-4bit?

  microsoft/VPTQ#200 · Filter by author LiMa-cas opened on Sep 3, 2025

• qwen3 support

  microsoft/VPTQ#197 · Filter by author LiMa-cas opened on Jul 7, 2025

• a version incompatibility issue

  microsoft/VPTQ#196 · Filter by author Zn0425 opened on May 22, 2025
  1

• Can you provide a script that can reproduce the results of the paper?

  microsoft/VPTQ#191 · Filter by author xuzukang opened on Mar 26, 2025
  11

  

• gemma-3 support

  microsoft/VPTQ#188 · Filter by author ZanePoe opened on Mar 17, 2025
  1

  

• Question about result reproduction

  microsoft/VPTQ#180 · Filter by author searchthe opened on Mar 6, 2025
  15

  

• when contribute VPTQ to llm compressor?

  microsoft/VPTQ#176 · Filter by author geqian-9192 opened on Feb 14, 2025
  1

• DeepSeek-R1 support

  new models
  microsoft/VPTQ#174 · Filter by author loretoparisi opened on Feb 7, 2025
  11

  

• Question about fine-tuning

  alogrithmenhancementquestion
  microsoft/VPTQ#136 · Filter by author kimwin2 opened on Dec 3, 2024
  5

• How to dequantize a model with 4 groups and centroids greater than 4096?

  bugquestion
  microsoft/VPTQ#128 · Filter by author ShawnzzWu opened on Nov 29, 2024
  6

• How to Generate a 2-bit Quantized Meta-Llama-3.1-8B-Instruct Model?

  question
  microsoft/VPTQ#126 · Filter by author ForAxel opened on Nov 21, 2024
  7

  

• Enhance the implementation of the CUDA inference kernel.

  features
  microsoft/VPTQ#118 · Filter by author haruhi55 opened on Nov 13, 2024
  2

  

• CPU support

  inference
  microsoft/VPTQ#114 · Filter by author YangWang92 opened on Nov 7, 2024
  2

  

• Custom Model support

  new modelsquestion
  microsoft/VPTQ#113 · Filter by author huangtingwei9988 opened on Nov 7, 2024
  3

• Add evaluation codes

  enhancement
  microsoft/VPTQ#102 · Filter by author YangWang92 opened on Oct 31, 2024
  1

• Add FP8/INT8 support

  alogrithm
  microsoft/VPTQ#88 · Filter by author YangWang92 opened on Oct 26, 2024
  3

  

• Improve hessian/invhessian collection

  alogrithm
  microsoft/VPTQ#79 · Filter by author YangWang92 opened on Oct 21, 2024
  3

  

• Add Ollama/llama.cpp/ggml support

  inference
  microsoft/VPTQ#77 · Filter by author YangWang92 opened on Oct 20, 2024
  1

  

• Add VLM/Multimodality support

  alogrithmnew models
  microsoft/VPTQ#76 · Filter by author YangWang92 opened on Oct 20, 2024
  

• Add vLLM support

  inference
  microsoft/VPTQ#75 · Filter by author YangWang92 opened on Oct 20, 2024
  3

  

• Does not work in Oobabooga

  inferencequestion
  microsoft/VPTQ#53 · Filter by author Kaszebe opened on Oct 8, 2024
  1