Skip to content

[TRTLLM-14510][feat] BREAKING: serve: default num_serve_frontends to 8 with single-frontend fallback - #19379

Open
lancelly wants to merge 9 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8
Open

[TRTLLM-14510][feat] BREAKING: serve: default num_serve_frontends to 8 with single-frontend fallback#19379
lancelly wants to merge 9 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8

[None][chore] serve: inline the num_serve_frontends default

d0ffa84
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 29, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO