Skip to content

Cars demo: show dot product calculation - #2004

Merged
kkraune merged 1 commit into
masterfrom
cars-demo-updates
Sep 29, 2026
Merged

kkraune merged 1 commit into
masterfrom
cars-demo-updates

Conversation

@radu-gheorghe

Copy link
Copy Markdown
Contributor

I've also updated the model to gpt-6-luna. There's still that thinking lag (see video), not sure if it's any better. Streaming would be a solution, but OpenAI don't stream thinking token (summaries) easily, and streaming the reply itself doesn't save much (most of the time is thinking).

720.mov

@kkraune kkraune left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will try this!

@kkraune
kkraune merged commit 8cba1c6 into master Sep 29, 2026
8 of 9 checks passed
@kkraune
kkraune deleted the cars-demo-updates branch September 29, 2026 08:11

This branch was successfully deployed

1 active deployment
Vespa Cloud CD — fffa5e53 Deployed Sep 29, 2026 by radu-gheorghe via Push to Vespa Cloud #1375
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants