Support for TrueFoundry AI Gateway as model provider

[chiragjn]

Summary

Support for TrueFoundry AI Gateway as model provider

How was this tested?

Checklist

• I have read the contributing guidelines
• pnpm build, pnpm test, pnpm typecheck, pnpm lint:ci, and pnpm format:check pass locally
• Tests added/updated where it makes sense
• No hand-edits to generated code (packages/trueforge-sdk, .github/fern/openapi/openapi.json, docs/openapi.json) — fork PRs omit SDK regen; maintainers regenerate after merge
• Docs / .env.example updated if configuration or behavior changed

---

Note

High Risk
Changes authentication (per-caller gateway tokens, OIDC mutual exclusion), routes all model listing and inference through external ServiceFoundry/Gateway, and passes caller tokens into LLM config—security- and availability-sensitive paths.

Overview
Adds TrueFoundry mode when TRUEFOUNDRY_SERVICEFOUNDRY_SERVER_URL is set: chat models are discovered from the ServiceFoundry server (caller Bearer/access cookie) and LLM calls go to the tenant’s default AI Gateway using that token. Startup rejects enabling OIDC alongside this mode.

Introduces a read-only truefoundry model provider (TrueFoundryModelProviderStore + TrueFoundryServiceFoundryServerClient), optional internal mTLS (TRUEFOUNDRY_MTLS_ENABLED / TRUEFOUNDRY_MTLS_CERTS_DIR), and resolveModelProviderStore(c) so HTTP handlers get a token-bound store while background jobs keep the DB store. Settings create/replace model provider returns 424 when resources are TrueFoundry-managed; OpenAPI/SDK gain TrueFoundryModelProvider, 401 on list models / create turn, and 424 on provider writes.

VercelAILLM treats truefoundry like other OpenAI-compatible providers (requires baseUrl). Auth middleware adds requireAccessToken and accessToken cookie reading; optional ACCESS_LOGS request logging. UI catalog typing excludes truefoundry from user-savable presets.

^{Reviewed by Cursor Bugbot for commit 08fc847. Bugbot is set up for automated code reviews on this repo. Configure here.}

[changeset-bot]

🦋 Changeset detected

Latest commit: 08fc847

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages

Name	Type
@truefoundry/trueforge-sdk	Patch
@truefoundry/trueforge	Minor
@truefoundry/trueforge-core	Minor
@truefoundry/trueforge-ui	Minor

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[thesujai]

Agent Creations Payload: {
    "name": "tfy-managedagent",
    "manifest": {
        "model": {
            "name": "anthropic-gateway/claude-opus-4-7",
            "params": {}
        },
        "config": {
            "iteration_limit": 100,
            "sandbox": {
                "enabled": true,
                "file_downloads": true
            },
            "dynamic_sub_agents": {
                "enabled": true
            },
            "context_management": {
                "compaction": {
                    "enabled": true
                },
                "large_tool_response": {
                    "enabled": true
                }
            },
            "generative_ui": {
                "enabled": true
            },
            "ask_user_questions": {
                "enabled": true
            }
        },
        "instructions": "you are dude",
        "mcp_servers": [],
        "skills": []
    }
}

Repose Agent creation: {
    "data": {
        "id": "01m1dpgezn9dphkbj5bcjtybzg",
        "name": "tfy-managedagent",
        "manifest": {
            "model": {
                "name": "anthropic-gateway/claude-opus-4-7",
                "params": {}
            },
            "instructions": "you are dude",
            "mcp_servers": [],
            "skills": [],
            "config": {
                "iteration_limit": 100,
                "sandbox": {
                    "enabled": true,
                    "file_downloads": true
                },
                "dynamic_sub_agents": {
                    "enabled": true
                },
                "context_management": {
                    "compaction": {
                        "enabled": true
                    },
                    "large_tool_response": {
                        "enabled": true
                    }
                },
                "generative_ui": {
                    "enabled": true
                },
                "ask_user_questions": {
                    "enabled": true
                }
            }
        }
    }
}

Session Creation(Inline): {
    "agent": {
        "spec": {
            "model": {
                "name": "agent-harness-anthropic/claude-opus-4-5",
                "params": {
                    "reasoning_effort": "low"
                }
            },
            "instructions": "you are dude",
            "config": {
                "iteration_limit": 100,
                "sandbox": {
                    "enabled": true,
                    "file_downloads": true
                },
                "dynamic_sub_agents": {
                    "enabled": true
                },
                "context_management": {
                    "compaction": {
                        "enabled": true
                    },
                    "large_tool_response": {
                        "enabled": true
                    }
                },
                "generative_ui": {
                    "enabled": true
                },
                "ask_user_questions": {
                    "enabled": true
                }
            },
            "mcp_servers": [],
            "skills": []
        }
    }
}
Response:
{
    "data": {
        "id": "01m1dttsfv058xht2tra7zgjj4",
        "agent": {
            "type": "inline",
            "spec": {
                "model": {
                    "name": "agent-harness-anthropic/claude-opus-4-5",
                    "params": {
                        "reasoning_effort": "low"
                    }
                },
                "instructions": "you are dude",
                "mcp_servers": [],
                "skills": [],
                "config": {
                    "iteration_limit": 100,
                    "sandbox": {
                        "enabled": true,
                        "file_downloads": true
                    },
                    "dynamic_sub_agents": {
                        "enabled": true
                    },
                    "context_management": {
                        "compaction": {
                            "enabled": true
                        },
                        "large_tool_response": {
                            "enabled": true
                        }
                    },
                    "generative_ui": {
                        "enabled": true
                    },
                    "ask_user_questions": {
                        "enabled": true
                    }
                }
            }
        },
        "title": null,
        "created_by": "trueforge-default",
        "created_at": "2026-09-01T06:34:50.730Z",
        "updated_at": "2026-09-01T06:34:50.730Z"
    }
}



Get models:
{
    "data": [
        {
            "name": "agent-harness-anthropic/claude-opus-4-5",
            "model_id": "agent-harness-anthropic/claude-opus-4-5",
            "provider": {
                "name": "agent-harness-anthropic"
            },
            "properties": {
                "context_length": 200000,
                "max_output_tokens": 64000,
                "reasoning_efforts": [
                    "low",
                    "medium",
                    "high"
                ]
            }
        }
        ...
    ]
}



Without Tfy Registry, Get models:
{
    "data": [
        {
            "name": "google-gemini/gemini-3-6-flash",
            "model_id": "gemini-3.6-flash",
            "provider": {
                "name": "google-gemini"
            },
            "properties": {
                "context_length": 1048576,
                "max_output_tokens": 65536,
                "reasoning_efforts": [
                    "minimal",
                    "low",
                    "medium",
                    "high"
                ]
            }
        }
    ]
}



These is no diff at all

cc @debajyoti-truefoundry @chiragjn

[cursor]

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 08fc847. Configure here.}