Issues

• Add a Kimi Delta Attention (KDA) linear-attention layer to Megatron Core

  community-request
  NVIDIA/Megatron-LM#7983 · Filter by author Aravind-11 opened on Oct 8, 2026

• Enable PAO for non-delayed FP8 recipes with BF16 storage

  enhancement
  NVIDIA/Megatron-LM#7968 · Filter by author CarlosGomes98 opened on Oct 8, 2026

• GTP DEBUG related Utils

  Enhancement

  NVIDIA/Megatron-LM#7967 · Filter by author fanshiqing opened on Oct 8, 2026
  

• [BUG] Hybrid NVLS batch-invariant prefill differs from full forward on the 26.09 CI stack

  bug
  NVIDIA/Megatron-LM#7958 · Filter by author balasaajay opened on Oct 8, 2026

• [Design Proposal] Custom dataloader contract and checkpoint integration

  NVIDIA/Megatron-LM#7951 · Filter by author maanug-nv opened on Oct 7, 2026

• [inference] Offloaded payload copies all conversation media to host under expanded-prefix stitching; carry only suffix media

  NVIDIA/Megatron-LM#7944 · Filter by author lauradang opened on Oct 7, 2026
  

• loader_mixtral_hf.py fails with transformers 5.x (version check and MoE expert layout)

  NVIDIA/Megatron-LM#7934 · Filter by author janbernloehr opened on Oct 7, 2026

• CI flake: worker TCPStore EADDRINUSE during functional-test startup

  bug
  NVIDIA/Megatron-LM#7920 · Filter by author balasaajay opened on Oct 6, 2026

• CI flake: MFSDPv2 hybrid-placement test hits CUDA 999 during all-gather

  bug
  NVIDIA/Megatron-LM#7918 · Filter by author balasaajay opened on Oct 6, 2026
  1

• [BUG] Megatron-FSDP silently skips LoRA updates for structured model outputs

  NVIDIA/Megatron-LM#7911 · Filter by author yuhezhang-ai opened on Oct 6, 2026

• Add GDN chunkwise CP with recurrent boundary-state propagation

  community-requestwaiting-on-maintainers
  NVIDIA/Megatron-LM#7909 · Filter by author ggboooy opened on Oct 6, 2026
  

• GPT-OSS post-training enables YaRN and a learned position table together

  community-request
  NVIDIA/Megatron-LM#7900 · Filter by author Aravind-11 opened on Oct 6, 2026

• [BUG] EP=1 disaggregated inference can crash on dummy recurrent-state allocation

  NVIDIA/Megatron-LM#7898 · Filter by author jthomson04 opened on Oct 5, 2026

• [RL] Make the advantage estimator and loss aggregation configurable (RLOO, Dr. GRPO, GSPO)

  community-requestwaiting-on-maintainers
  NVIDIA/Megatron-LM#7893 · Filter by author Aravind-11 opened on Oct 5, 2026
  

• [Design proposal]: shared residual-connection integration for mHC and Wide Residual

  enhancement
  Enhancement

  NVIDIA/Megatron-LM#7888 · Filter by author kwangjunahn opened on Oct 5, 2026
  4

  

• Megatron-LM Monthly Activity Report — October 2026 (through October 4, 2026)

  NVIDIA/Megatron-LM#7882 · Filter by author lhb8125 opened on Oct 5, 2026

• [BUG] Low-precision temperature scaling changes TorchSampling output at temperature=0.1 and 0

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA/Megatron-LM#7857 · Filter by author Waterpine opened on Oct 4, 2026

• [BUG] BF16 Mamba/GDP multi-token decode and rollback states differ from serial decode

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA/Megatron-LM#7856 · Filter by author Waterpine opened on Oct 4, 2026
  

• [BUG] Fused softmax path ignores window_size for sliding-window attention

  bugcommunity-request
  NVIDIA/Megatron-LM#7847 · Filter by author DhineshPonnarasan opened on Oct 3, 2026

• [BUG] GDP prefix caching produces different tokens with CUDA graphs enabled

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA/Megatron-LM#7845 · Filter by author Waterpine opened on Oct 3, 2026
  

• fix(inference): handle SSM-only handoff when all KV blocks are cached

  NVIDIA/Megatron-LM#7837 · Filter by author jthomson04 opened on Oct 2, 2026

• [BUG] One-token disaggregated handoff stalls subsequent requests with EP enabled

  bug
  NVIDIA/Megatron-LM#7835 · Filter by author jthomson04 opened on Oct 2, 2026

• [Tracking] Bitwise train/generation parity for RL: batch-invariant inference + the training forward

  community-requestenhancementwaiting-on-maintainers
  NVIDIA/Megatron-LM#7831 · Filter by author YigongQin opened on Oct 2, 2026
  

• [BUG] Block CUDA graphs can replay stale pipeline receive buffers in hybrid inference

  NVIDIA/Megatron-LM#7829 · Filter by author jthomson04 opened on Oct 2, 2026

• Support request-local sampling seeds in dynamic inference

  NVIDIA/Megatron-LM#7827 · Filter by author wdykas opened on Oct 2, 2026
  1