feat: add OrcaRouter as a first-class model provider - #503
Open
zsanig22-dotcom wants to merge 1 commit into
Open
feat: add OrcaRouter as a first-class model provider#503zsanig22-dotcom wants to merge 1 commit into
zsanig22-dotcom wants to merge 1 commit into
Conversation
Wire OrcaRouter into the existing well-known provider registry as an OpenAI-compatible gateway: core adapter case, manifest schema with a default base URL, shipped catalog presets, and docs entry. Co-Authored-By: Claude <noreply@anthropic.com>
zsanig22-dotcom
requested review from
bhaveshpatel640,
chiragjn,
debajyoti-truefoundry,
heerambavi1998,
sr07asthana and
thesujai
as code owners
August 30, 2026 01:26
🦋 Changeset detectedLatest commit: 3bc7d42 The changes in this PR will be included in the next version bump. This PR includes changesets to release 2 packages
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
TrueForge is "the open-source agent harness — the runtime layer that turns an LLM into a working agent", and its model layer already speaks "OpenAI, Anthropic, Google Gemini, and other catalog providers, or any OpenAI-compatible endpoint." This PR adds OrcaRouter as a first-class, named catalog provider, mirroring how the existing well-known providers (OpenAI, Anthropic, Together, Z AI, …) are wired end-to-end — not as an anonymous
custombase URL.OrcaRouter is an OpenAI-compatible AI gateway built for both models and agents. Like OpenRouter, it exposes a provider/model namespace across many models — but it also combines adaptive routing, automatic failover, zero-markup inference, observability, guardrails, and agent-tool governance behind the same endpoint. Adding
orcarouteras a first-class provider means TrueForge users can use that stack directly, without treating OrcaRouter as a bare custom endpoint. It also runs gateway-level, zero-trust security for AI agents on the same endpoint — screening every prompt/response and governing every tool call on a default-deny basis, with no application code changes.Changes
Every well-known provider in TrueForge touches five places, and this PR follows that same parallel structure for
orcarouter:together)orcarouterchangepackages/trueforge-core/src/core/llm/VercelAILLM.ts—VERCEL_AI_PROVIDER_NAMESentry +buildLanguageModelcase (OpenAI-compatible adapter)orcarouteradded to the provider registry and to the samecompatibleModelcase shared by Fireworks / Z AI / Togetherpackages/trueforge/src/schemas/modelProvider.ts—wellKnownProviderSchemawith a defaultbase_urlOrcaRouterModelProviderSchema(https://api.orcarouter.ai/v1), registered in theModelProviderManifestdiscriminated unionpackages/trueforge/catalog/model-catalog.yaml— discovery presetsorcarouterpreset with its gateway-native models (orcarouter/auto,orcarouter/fusion,orcarouter/fusion-mini,orcarouter/fusion-flash)docs/models.mdx— "Supported providers" tableorcarouterrow with the provider link.changeset/*.mdorcarouter-provider.md(minor for@truefoundry/trueforgeand@truefoundry/trueforge-core)No new dependencies: OrcaRouter speaks the OpenAI-compatible protocol, so it reuses the existing
@ai-sdk/openai-compatibleadapter that Fireworks and Together already go through.packages/trueforge-sdkis generated in CI from the OpenAPI spec, so this fork PR omits SDK regeneration per the contributing guide.How was this tested?
pnpm --filter @truefoundry/trueforge-core typecheckandpnpm --filter @truefoundry/trueforge typecheckpass (includes the teststsconfigs).pnpm --filter @truefoundry/trueforge-core test— 388 tests pass, includingVercelAILLM.model.test.tsand the manifest schema tests that iterate everyVERCEL_AI_PROVIDER_NAMESentry.pnpm --filter @truefoundry/trueforge test— 293 tests pass, including thecatalog presets are configurablesuite that PUTs every shipped catalog preset (the neworcarouterone included) and the "can configure every adapter the harness can build" schema test.buildLanguageModelorcarouterpath againsthttps://api.orcarouter.ai/v1withorcarouter/fusion-flashreturned a successful turn.Checklist
pnpm build,pnpm test,pnpm typecheck,pnpm lint:ci, andpnpm format:checkpass locally (see note below)packages/trueforge-sdk,.github/fern/openapi/openapi.json,docs/openapi.json) — fork PRs omit SDK regen; maintainers regenerate after merge.env.exampleupdated if configuration or behavior changedI'm an engineer on the OrcaRouter team. Feedback welcome — Discord: discord.gg/YEubt8enRA · X: https://x.com/OrcaRouter
Note
Low Risk
Additive provider registration and catalog/docs only; reuses the existing OpenAI-compatible adapter with no changes to auth, persistence, or agent runtime logic.
Overview
Adds
orcarouteras a named catalog provider so users can configure OrcaRouter with a default API base URL instead of a genericcustomendpoint.Wiring matches other OpenAI-compatible well-known providers: it is registered in
VERCEL_AI_PROVIDER_NAMES, routed through the sharedcompatibleModelpath inbuildLanguageModel, and exposed viaOrcaRouterModelProviderSchema(https://api.orcarouter.ai/v1) in the model-provider manifest union. The shipped catalog gains presets fororcarouter/auto,fusion,fusion-mini, andfusion-flash(with context/reasoning metadata where applicable). Docs and a minor changeset for@truefoundry/trueforgeand@truefoundry/trueforge-coreare included; no new dependencies.Reviewed by Cursor Bugbot for commit 3bc7d42. Bugbot is set up for automated code reviews on this repo. Configure here.