Repository navigation
Conversation
List CC 11.0 (Jetson AGX Thor) in the compute capability and format tables. The capability checks in transformer_engine/pytorch/quantization.py already enable FP8, FP8 block scaling, MXFP8 and NVFP4 there, and get_default_fp8_recipe() returns MXFP8BlockScaling. Footnote 3 said MXFP8 was limited to 10.x, but the check covers 10.0 through 11.x. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
docs/support_matrix.rstdoes not list compute capability 11.0 (Jetson AGX Thor). Footnote 3 also says MXFP8 is limited to 10.x, but_compute_mxfp8_support()intransformer_engine/pytorch/quantization.pyenables it from 10.0 up to, but not including, 12.0, which includes 11.0.This follows up on #2556, where I posted a full L0 run on Jetson AGX Thor: #2556 (comment)
Depends on #3706. The 11.0 NVFP4 cell says "Yes" because stochastic rounding in the RHT cast-fusion kernels works on 11.0 only with that fix. Without it, the default NVFP4 recipe returns all-zero wgrad on 11.0. If #3706 does not land, that cell should be "Partial" with a footnote like the one for 12.x.
Type of change
Changes
MXFP8BlockScaling.Basis
Jetson AGX Thor, JetPack 7.2, CUDA 13.2, cuDNN 9.20, TE built from source with
NVTE_CUDA_ARCHS=110.is_fp8_available(),is_fp8_block_scaling_available(),is_mxfp8_available()andis_nvfp4_available()all returnTrue, andget_default_fp8_recipe()returnsMXFP8BlockScaling.test_mxfp8: 447 passed, 0 failed). Other MXFP8-related failures fall into two groups. Four are attention tests: MXFP8 FusedAttention needs cuDNN 9.21 or newer on any architecture, and JetPack 7.2 ships 9.20. Two aretest_grouped_mlpcases for the CuTeDSL fused grouped MLP. TE enables that path only on 10.x, and its cuDNN-frontend kernel usesredux.f32, whichsm_110alacks (CuTeDSL grouped GEMM wrappers accept SM110 (Jetson Thor) but fail in ptxas:redux.f32not supported on sm_110a cudnn-frontend#1686). Neither affects the recipe-level support this table describes.tests/pytorch/nvfp4: 9314 passed, 0 failed with [Common] Use software stochastic rounding in the RHT cast fusion kernels #3706; 15 failed without it.I did not build the Sphinx docs. The change adds table rows in the existing format and edits two footnotes.
Checklist:
🤖 Generated with Claude Code