Repository navigation

[Common][PyTorch] Add row-scaled NVFP4 support to grouped-tensor GEMM - #3661

Open

cael-ling wants to merge 28 commits into

NVIDIA:mainfrom

cael-ling:pr/nvfp4-row-scaled-grouped-tensor-gemm

Open

[Common][PyTorch] Add row-scaled NVFP4 support to grouped-tensor GEMM#3661
cael-ling wants to merge 28 commits into
NVIDIA:mainfrom
cael-ling:pr/nvfp4-row-scaled-grouped-tensor-gemm

Commits on Oct 8, 2026
- [Common][PyTorch] Add NVFP4 row-scaled grouped cast with graph-safe path
  cael-ling
  committed
  148f681
- Address review: guard grouped row-scaled cast dispatch and inputs
  cael-ling
  committed
  b58bbe1
Commits on Oct 9, 2026
- Guard row-scaled grouped cast against non-2D, partial, and strided routing
  cael-ling
  committed
  0af4dd9
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  07de769
- Fall back to per-expert cast for mixed NVFP4 row/tensor-scaled splits
  cael-ling
  committed
  5536e0c
- Add row-scaled NVFP4 support to grouped-tensor GEMM
  cael-ling
  committed
  91e5585
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  
  pre-commit-ci[bot]
  authored and
  cael-ling
  committed
  26ab746
- Harden row-scaled grouped GEMM post-scale and operand checks
  cael-ling
  committed
  2ce6e70
- Apply row-scaled grouped GEMM column scales over actual group rows
  cael-ling
  committed
  3259847
- Make grouped row-scaled GEMM column post-scale graph-safe
  cael-ling
  committed
  07ceda5
- Fix grouped row-scaled GEMM post-scale gating and cuBLAS test skip
  cael-ling
  committed
  e2517b9
Commits on Oct 22, 2026
Commits on Oct 26, 2026
- Fold row-scaled NVFP4 amax into nvte_group_amax
  
  timmoon10
  and
  claude
  committed
  0432c8e
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  55f69ca
- Fix missing include
  timmoon10
  committed
  32c57f2
Commits on Oct 27, 2026
Commits on Nov 6, 2026
- Address review feedback on row-scaled NVFP4 grouped GEMM
  cael-ling
  committed
  67e7ea6
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  f3aedc9
Commits on Nov 7, 2026
- Merge branch 'main' into pr/nvfp4-row-scaled-grouped-tensor-gemm
  timmoon10
  authored
  adfbe2d

Navigation Menu

Repository navigation

[Common][PyTorch] Add row-scaled NVFP4 support to grouped-tensor GEMM - #3661

[Common][PyTorch] Add row-scaled NVFP4 support to grouped-tensor GEMM#3661
cael-ling wants to merge 28 commits into
NVIDIA:mainfrom
cael-ling:pr/nvfp4-row-scaled-grouped-tensor-gemm

Commits on Oct 8, 2026

[Common][PyTorch] Add NVFP4 row-scaled grouped cast with graph-safe path

Address review: guard grouped row-scaled cast dispatch and inputs

Commits on Oct 9, 2026

Guard row-scaled grouped cast against non-2D, partial, and strided routing

[pre-commit.ci] auto fixes from pre-commit.com hooks

Fall back to per-expert cast for mixed NVFP4 row/tensor-scaled splits

Add row-scaled NVFP4 support to grouped-tensor GEMM

[pre-commit.ci] auto fixes from pre-commit.com hooks

Harden row-scaled grouped GEMM post-scale and operand checks

Apply row-scaled grouped GEMM column scales over actual group rows

Make grouped row-scaled GEMM column post-scale graph-safe

Fix grouped row-scaled GEMM post-scale gating and cuBLAS test skip

Commits on Oct 22, 2026

Route row-scaled NVFP4 grouped quantize through nvte_group_quantize

[pre-commit.ci] auto fixes from pre-commit.com hooks

Require 128-row experts for uniform row-scaled NVFP4 group_quantize

[pre-commit.ci] auto fixes from pre-commit.com hooks

Merge branch 'pr/nvfp4-row-scaled-grouped-cast' into pr/nvfp4-row-scaled-grouped-tensor-gemm

Use tex.group_quantize for row-scaled grouped GEMM tests

Trim comments in row-scaled grouped GEMM

[pre-commit.ci] auto fixes from pre-commit.com hooks

Commits on Oct 26, 2026

Fold row-scaled NVFP4 amax into nvte_group_amax

[pre-commit.ci] auto fixes from pre-commit.com hooks

Fix missing include

Commits on Oct 27, 2026

Add missing header include

Merge branch 'pr/nvfp4-row-scaled-grouped-cast' into pr/nvfp4-row-scaled-grouped-tensor-gemm

Merge branch 'main' into pr/nvfp4-row-scaled-grouped-tensor-gemm

Commits on Nov 6, 2026

Address review feedback on row-scaled NVFP4 grouped GEMM

[pre-commit.ci] auto fixes from pre-commit.com hooks

Commits on Nov 7, 2026

Merge branch 'main' into pr/nvfp4-row-scaled-grouped-tensor-gemm