vLLM support #42

Open

Labels

opened

on Apr 25, 2025

Overview
Add support for vLLM backend through transformers for all existing community models

Requirements
Tests must prove compatibility for all of all changes across all impacted components and devices.

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests