EmbeddedLLM
We are committed to making production-grade AI inference as accessible and reliable as electricity, powered by vLLM.
Pinned Loading
Repositories
Showing 10 of 79 repositories
- agentic-api Public Forked from vllm-project/agentic-api
Stateful API logic for agentic applications using vLLM
EmbeddedLLM/agentic-api’s past year of commit activity - litellm Public Forked from BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
EmbeddedLLM/litellm’s past year of commit activity - TokenVisor-charts Public
EmbeddedLLM/TokenVisor-charts’s past year of commit activity - vllm Public Forked from vllm-project/vllm
vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
EmbeddedLLM/vllm’s past year of commit activity - tokenvisor-pi Public
EmbeddedLLM/tokenvisor-pi’s past year of commit activity - fastsafetensors Public Forked from foundation-model-stack/fastsafetensors
High-performance safetensors model loader
EmbeddedLLM/fastsafetensors’s past year of commit activity - vllm-omni Public Forked from vllm-project/vllm-omni
A high-throughput and memory efficient inference and serving engine for Omni-modality models
EmbeddedLLM/vllm-omni’s past year of commit activity - vllm-rocm-wheel Public
EmbeddedLLM/vllm-rocm-wheel’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…