Skip to content

0.3.3a1: every loop knob in planner and auto-tune, probe scores cross-entropy, demo model under demos/ - #57

Merged
FonaTech merged 1 commit into
devfrom
loop-gaps-0.3.3a1
Nov 12, 2026
Merged

FonaTech merged 1 commit into
devfrom
loop-gaps-0.3.3a1

Conversation

@FonaTech

Copy link
Copy Markdown
Owner

0.3.3a1

This PR closes the gaps left by 0.3.3a0. Kernel defaults are unchanged.

Planner

A looped plan (recurrent_depth > 1) now also recommends six more loop knobs. Each comes with a sources entry that gives the 15M measurement behind it:

  • recurrent_later_topk=0
  • recurrent_later_groups=0 (never 1)
  • lambda_iteration_cluster=0
  • lookahead_teacher_scope="first"
  • recurrent_dt_min=0.05
  • recurrent_dt_max=1.0

The Web UI shows these as planner recommendations, and ui/presets_v3.json is regenerated.

Auto-tune

  • All nine loop knobs are searchable.
    • recurrent_later_groups is offered as 0 or 2, never 1, and only in block order.
    • The loop probe now has 4 block layers.
    • A drawn dt_init is clamped into the drawn [dt_min, dt_max].
    • Each trial logs its median step time.
  • Fix: the probe score included the weighted regularizers. The probe now trains on chronos_loss_term and scores cross-entropy.
  • Fix: lambda_lookahead never reached the probe. With 1e-3 and 1.0, scores now differ after the first update.

Web UI

  • Fix: Field.as_dict dropped 0 and 0.0 because 0 == False, so 48 fields lost min=0. It now drops only unset values.
  • Help text gives the measured reasons in en, zh-Hans, zh-Hant and ja.

Translation demo

  • models/chronos-enzh-50m-sft and its driver test now live under demos/translation/. CI runs the driver test as a separate step.
  • The main READMEs name the demo in one pointer paragraph. The measurement conditions moved to the demo READMEs.
  • test_task_models_and_tests_live_under_demos checks both.

Verified locally

  • Full suite on macOS (Apple silicon, Python 3.11, MLX on CPU): 728 passed, 4 skipped. ruff check . passes.
  • The demo driver test (15 items) passes from its new folder.
  • Wheel and sdist both carry the general_32k tokenizer. Neither carries demos/, a model folder or weights.
  • End to end through the Web UI auto-tune endpoint (in-process client, no port): 4 trials × 10 steps searched all nine loop knobs plus lambda_lookahead. Every trial completed, and the best patch carries every searched knob.

Open

  • The loop-knob recommendations rest on one seed at 15M.
  • Lazy block-order serving is not measured.
  • Part of the extra step time of looped training is still unattributed.

🤖 Generated with Claude Code

…-entropy, demo model under demos/

Planner: a looped plan also sets recurrent_later_topk=0, recurrent_later_groups=0,
lambda_iteration_cluster=0, lookahead_teacher_scope="first", recurrent_dt_min=0.05 and
recurrent_dt_max=1.0, each with a sources entry stating the 15M measurement behind it. The Web UI
shows them as planner recommendations; presets_v3.json is regenerated.

Auto-tune: all nine loop knobs are searchable (later_groups 0 or 2, never 1; block order only).
The loop probe has 4 block layers, clamps a drawn dt_init into the drawn range and logs each
trial's median step time. The probe now trains on chronos_loss_term and scores cross-entropy:
the old score added the weighted regularizers, and lambda_lookahead never reached the probe.

Web UI: Field.as_dict dropped 0 and 0.0 (0 == False), so min=0 and recommended=0 never reached the
page; it now drops only unset values. Help text gives the measured reason in four languages.

Translation demo: models/chronos-enzh-50m-sft and its driver test moved under demos/translation;
CI runs the driver test in its own step. The main READMEs name the demo in one pointer paragraph;
the measurement conditions moved to the demo READMEs. A guard test checks both.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@FonaTech
FonaTech merged commit 4a92c06 into dev Nov 12, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant