Skip to content

Commit c402353

Browse files
Liclaude
andcommitted
[moe training] Assert pad_token_groups_for_grouped_mm is False (not yet supported)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent c93b8f8 commit c402353

1 file changed

Lines changed: 3 additions & 0 deletions

File tree

torchao/prototype/moe_training/fp8_grouped_mm.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,9 @@ def forward(
7676
float8_dtype: torch.dtype = torch.float8_e4m3fn,
7777
pad_token_groups_for_grouped_mm: bool = True,
7878
) -> torch.Tensor:
79+
assert not pad_token_groups_for_grouped_mm, (
80+
"pad_token_groups_for_grouped_mm=True is not yet supported"
81+
)
7982
# torchao _quantize_then_scaled_grouped_mm only supports A=2D|3D and B=3D.
8083
assert A.ndim == 2 or A.ndim == 3, "A must be 2D or 3D"
8184
assert B_t.ndim == 3, "B must be 3D"

0 commit comments

Comments
 (0)