Transformers support for GPTQ quantizations #13

Open

Labels

enhancementgood first issue

opened

on Apr 12, 2025

Overview
Add support for GPTQ quants on transformers for all existing community models

Requirements

Tests must prove compatibility for all of all changes across all impacted components and devices.

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

enhancementgood first issue

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests