Skip to content

Describe the Kubernetes autoscaler on both auto-replica screens - #408

Merged
Priyanshu-u07 merged 1 commit into
mainfrom
fix/auto-replica-text-on-k8s-pools
Oct 14, 2026
Merged

Priyanshu-u07 merged 1 commit into
mainfrom
fix/auto-replica-text-on-k8s-pools

Conversation

@Priyanshu-u07

Copy link
Copy Markdown
Collaborator

Fixes #329

On a Kubernetes pool, both auto-replica screens said the platform would provision new nodes when tokens/sec dropped below a threshold. On Kubernetes, KEDA adds replicas from in-flight requests with a P95 latency guard, and the tokens/sec threshold is not used.

  • Create form: on a Kubernetes pool the section now describes replica scaling and drops the tokens/sec field. Other pools are unchanged.
  • Configuration tab: its fields were already correct for Kubernetes, but the toggle label above them still promised new nodes. Now it doesn't.

Both screens decide by the pool's provider being k8s, the same check the Configuration tab already used.

A tokens/sec value can still be stored for a Kubernetes deployment, but it is never acted on: the TPS autoscaler's query already excludes Kubernetes pools.

Signed-off-by: Priyanshu-u07 <connect.priyanshu8271@gmail.com>
@Priyanshu-u07
Priyanshu-u07 merged commit 4f91301 into main Oct 14, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Dashboard: Auto-Replica text is wrong for Kubernetes pools

1 participant