Skip to content

fix: enhance service health notebook with detailed topology descripti… - #11

Merged
shackmann merged 1 commit into
mainfrom
stefan/health-instances-example
Aug 27, 2026
Merged

fix: enhance service health notebook with detailed topology descripti…#11
shackmann merged 1 commit into
mainfrom
stefan/health-instances-example

Conversation

@shackmann

@shackmann shackmann commented Aug 27, 2026

Copy link
Copy Markdown
Collaborator

…on and caching improvements


Note

Low Risk
Notebook-only documentation and diagnostic output; no runtime library or service behavior changes in this diff.

Overview
Expands service_health.ipynb so multi-deployment setups are easier to diagnose without duplicating health traffic.

The intro now documents how JOINTFM_DEPLOYMENT_IDS round-robin pools work: health() aggregates consensus metadata (notably minimum reachable max_sample_count for sample-batch splitting), and cache=True on the first fetch lets the new topology section reuse that probe.

A Deployment Topology section calls health_instances(cache=True) and prints selector, topology_label, parallel capacity (sum of caps) vs sample-batch cap (minimum), plus per-deployment availability, predict URL, device, image/checkpoint versions, and errors for unreachable peers.

The health fetch cell uses health(cache=True, refresh=True) and drops the redundant trailing cell output; the notebook kernelspec is renamed to Python (joint-client-python).

Reviewed by Cursor Bugbot for commit f64a8be. Bugbot is set up for automated code reviews on this repo. Configure here.

@shackmann
shackmann merged commit b71cbff into main Aug 27, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant