Skip to content

[Qwen3.5 moe] : fix vision shape mismatch - #1348

Open
quic-mamta wants to merge 3 commits into
quic:mainfrom
quic-mamta:qwen_fix
Open

quic-mamta wants to merge 3 commits into
quic:mainfrom
quic-mamta:qwen_fix

Conversation

@quic-mamta

@quic-mamta quic-mamta commented Sep 16, 2026 •

Copy link
Copy Markdown
Contributor

This PR fixes Qwen3.5 MoE vision shape handling for batched inputs.

Key changes:

  • Expands vision rotary positional embeddings across the batch dimension so they align with batched patch tokens.
  • Updates dummy Qwen3.5 MoE vision input shapes so pixel_values scales with batch size instead of using a fixed single-grid size.
  • Updates the Qwen3.5 MoE disaggregated mode example to:
    • Compile/run vision with a single prompt slot.
    • Filter and cast inputs according to session bindings.
    • Use KV DMA handoff between prefill and decode sessions.
    • Cleanly deactivate and unload sessions.
  • Adds CPU unit coverage to verify Qwen3.5 MoE vision output shape for batched patch tokens.

Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta quic-mamta changed the title fix vision shape mismatch [Qwen3.5 moe] : fix vision shape mismatch Sep 16, 2026
@quic-mamta quic-mamta self-assigned this Sep 16, 2026
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta
quic-mamta requested a review from mohiso22 September 17, 2026 05:43

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant