Repository navigation
feat: add Smart Route starters that come with rules - #10
Open
ashokgelal wants to merge 1 commit into
Open
ashokgelal wants to merge 1 commit into
ashokgelal wants to merge 1 commit into
Conversation
Three starters come with a rule: Budget-aware, Private by default, and Try a new model. A rule names no model. It sends to the fallback or the router model, or gives a hint the person picks a model for, as they do for each choice. They sit in a new rule_starters list. Runtimes that predate starter rules read only starters, so they never offer one without its rules, and they skip the new collection.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds three Smart Route starters that come with a rule. This pairs with cloudstack-llc/msty-nexus#633, which teaches the Runtime and the console to read them.
A rule names no model. It sends to
fallbackorrouter, or gives atarget_hintthat the person picks a model for in the template step, as they do for each choice.Older Runtimes
The new starters sit in a new
rule_starterslist. A Runtime that predates starter rules reads onlystarters, so it never offers one of these without its rule. Collections already skip a starter they cannot find, so these Runtimes also drop the new "Starters with rules" collection.schema_versionstays 1.Checks
node --test scripts/smart-route-starters.test.mjs: 8 pass, with new tests for rule starters.node scripts/smart-route-starters-verify.mjs: ok, 25 starters, 3 with rules.Merge once msty-nexus#633 ships. Merging earlier is harmless, because older Runtimes ignore the new list.