You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fixed in integration branch integrate/open-prs-and-issues (PR #16):
Tool-only assistant turns: OpenAI-compat backends that enforce strict JSON schema now get content: null (not empty string "") when an assistant message has only tool_calls and no text. This matches what strict upstreams expect.
Context-length 400s: When upstream returns errors mentioning context length / maximum context, the proxy now attaches a clearer hint in logs/responses pointing at session compaction, shorter prompts, or switching to a larger window route (including [1m] where configured).
If you're still hitting failures after updating, please paste the exact upstream error text (or a redacted screenshot) and which backend route/model you had selected — that'll help confirm whether it's the tool-only case, a true overflow, or something else.
Already resolved on main (landed via PR #16): openai_compat tool-only assistant turns now send content: null for strict-schema backends, and upstream context-length errors get a clearer hint (compaction / shorter prompt / larger-window [1m] route). This behavior is verified by the offline 'openai_compat long-context hygiene: tool-only content=null + context hint' self-test in test_proxy.py, which passes in CI on #28. Closing as fixed; please reopen with the exact upstream error text + selected route if you still hit it.
Activity
OnlyTerp commentedon Jun 11, 2026
Fixed in integration branch
integrate/open-prs-and-issues(PR #16):Tool-only assistant turns: OpenAI-compat backends that enforce strict JSON schema now get
content: null(not empty string"") when an assistant message has onlytool_callsand no text. This matches what strict upstreams expect.Context-length 400s: When upstream returns errors mentioning context length / maximum context, the proxy now attaches a clearer hint in logs/responses pointing at session compaction, shorter prompts, or switching to a larger window route (including
[1m]where configured).If you're still hitting failures after updating, please paste the exact upstream error text (or a redacted screenshot) and which backend route/model you had selected — that'll help confirm whether it's the tool-only case, a true overflow, or something else.
fix: remaining PR #13 + issues #14/#15 (post #11/#12 merge)
Merge pull request #16 from OnlyTerp/integrate/open-prs-and-issues
devin-ai-integration commentedon Jun 18, 2026
Already resolved on
main(landed via PR #16): openai_compat tool-only assistant turns now sendcontent: nullfor strict-schema backends, and upstream context-length errors get a clearer hint (compaction / shorter prompt / larger-window [1m] route). This behavior is verified by the offline 'openai_compat long-context hygiene: tool-only content=null + context hint' self-test in test_proxy.py, which passes in CI on #28. Closing as fixed; please reopen with the exact upstream error text + selected route if you still hit it.