Skip to content

[Bugfix] Fix Cosmos3 FP8 tensor parallelism - #14921

Open
yzhautouskay wants to merge 1 commit into
huggingface:mainfrom
yzhautouskay:yzhautouskay/cosmos3_fp8_tp_fix
Open

yzhautouskay wants to merge 1 commit into
huggingface:mainfrom
yzhautouskay:yzhautouskay/cosmos3_fp8_tp_fix

Conversation

@yzhautouskay

Copy link
Copy Markdown
Contributor

What does this PR do?

Skip ModelOpt quantizer children during row-wise sharding to fix:
AttributeError: 'TensorQuantizer' object has no attribute 'weight'

Tested with nvidia/Cosmos3-Super, revision fp8, using mixed W8A16/W8A8 inference on GB200: TP2/CP2 and TP4/CP1, 720p, 189 frames, 35 steps.

tp_fp8.mp4

Before submitting

  • Did you use an AI agent (Claude Code, Codex, Cursor, etc.) to help with this PR? If so:
    • Did you read the Coding with AI agents guide?
    • Did you run the self-review skill on the diff?
    • Did you share the final self-review notes in the PR description or a comment?
  • Did you read the contributor guideline?
  • Did you read our philosophy doc? (important for complex PRs)
  • Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
  • Did you make sure to update the documentation with your changes? Here are the
    documentation guidelines, and
    here are tips on formatting docstrings.
  • Did you write any new necessary tests?
  • Are you the author (or part of the team) of the model/pipeline (only applicable for model/pipeline related PRs)?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@github-actions github-actions Bot added examples size/S PR with diff < 50 LOC labels Oct 1, 2026
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Hi @yzhautouskay, thanks for the PR! It does not appear to link an issue it fixes. If this PR addresses an existing issue, please add a closing keyword (e.g. Fixes #1234) to the PR description so the issue is linked. See the contribution guide for more details. If this PR intentionally does not fix a tracked issue, a maintainer can add the no-issue-needed label to silence this reminder.

Please note that PRs without a linked issue are likely to be automatically closed 10 days after this notice.

Once the PR links an issue (or gets the no-issue-needed label), you can ignore this message — it stays here as a comment, but it no longer applies.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples size/S PR with diff < 50 LOC

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant