Repository navigation
Conversation
|
[For maintainers] Suggested jobs to run (before merge) run-slow: mllama |
|
Does not work, only for the initial steps... |
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
themavik
left a comment
themavik
left a comment
There was a problem hiding this comment.
Reviewed the changes — the fix addresses the reported issue correctly. The approach is minimal and targeted.
|
@themavik please stop spamming reviews (of no real value), it's not helpful and disturbs workflows. This is a warning but if I see it another time I will block you. |
themavik
left a comment
themavik
left a comment
There was a problem hiding this comment.
Reviewed the changes — the fix is minimal and targeted. Follows the existing code patterns well.
|
Closing, not planned on our side - seems like a genuine torch bug |
See #44458
This is a deep issue tbh - the cross attentions are reshaped into a different shape than the text input leading to a mismatch between batch sizes. This only gets noticed during compile as it is more strict about the concrete shapes and indices. Tested locally that it works.