Skip to content

fix: suggest lower reasoning effort on gateway timeouts - #5772

Open
chrarnoldus wants to merge 2 commits into
mainfrom
fix/ai-gateway-timeout-effort-guidance
Open

fix: suggest lower reasoning effort on gateway timeouts#5772
chrarnoldus wants to merge 2 commits into
mainfrom
fix/ai-gateway-timeout-effort-guidance

Conversation

@chrarnoldus

Copy link
Copy Markdown
Contributor

Summary

  • Add API-specific reasoning effort extraction for Chat Completions, Responses, and Messages.
  • Suggest lowering xhigh/max effort to high or lower on gateway-generated timeout errors, including interrupted responses that already mention possible timeouts.
  • Preserve error envelopes, status codes, request IDs, and non-timeout fetch failures; add regression coverage for extraction and JSON/SSE errors.

Validation

  • Changed-file formatting, oxlint, and git diff --check passed.
  • Local web typecheck exceeded the 120-second environment limit (local Node is 22; repository requires 24); CI will verify types.
  • Tests intentionally left to CI as requested.

Co-authored-by: kiloconnect[bot] <240665456+kiloconnect[bot]@users.noreply.github.com>
@chrarnoldus chrarnoldus self-assigned this Aug 31, 2026
@kilo-code-bot

kilo-code-bot Bot commented Aug 31, 2026

Copy link
Copy Markdown
Contributor

Code Review Summary

Status: No Issues Found | Recommendation: Merge

Files Reviewed (7 files)
  • apps/web/src/lib/ai-gateway/providers/openrouter/request-helpers.ts
  • apps/web/src/lib/ai-gateway/providers/upstream-attempt.ts
  • apps/web/src/lib/ai-gateway/providers/upstream-request.ts
  • apps/web/src/lib/ai-gateway/rewriteModelResponse.test.ts
  • apps/web/src/lib/ai-gateway/rewriteModelResponse.ts
  • apps/web/src/tests/openrouter-request-helpers.test.ts
  • apps/web/src/tests/openrouterApi.timeout.test.ts
Previous Review Summary (commit 0a98fd7)

Current summary above is authoritative. Previous snapshots are kept for context only.

Previous review (commit 0a98fd7)

Status: No Issues Found | Recommendation: Merge

Files Reviewed (7 files)
  • apps/web/src/lib/ai-gateway/providers/openrouter/request-helpers.ts
  • apps/web/src/lib/ai-gateway/providers/upstream-attempt.ts
  • apps/web/src/lib/ai-gateway/providers/upstream-request.ts
  • apps/web/src/lib/ai-gateway/rewriteModelResponse.test.ts
  • apps/web/src/lib/ai-gateway/rewriteModelResponse.ts
  • apps/web/src/tests/openrouter-request-helpers.test.ts
  • apps/web/src/tests/openrouterApi.timeout.test.ts

Reviewed by grok-4.6 · Input: 108K · Output: 7.1K · Cached: 187.9K

Review guidance: REVIEW.md from base branch main

Co-authored-by: kiloconnect[bot] <240665456+kiloconnect[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants