Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
689 Open 3,699 Closed
689 Open 3,699 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[fix] Give same-key GTP chain neighbours distinct gather buffers complexity: low nemotron
#6207 opened Aug 3, 2026 by fanshiqing Member Loading…
6 tasks done
@fanshiqing
2
[Dev] Cut per-layer CPU overhead in the DSA pre-attention path
#6206 opened Aug 3, 2026 by jingqiny-99 • Draft
2
Roll packed MTP tensors using padded sequence boundaries community-request
#6205 opened Aug 3, 2026 by bzantium • Draft
4 of 6 tasks
1
[Dev] Add configurable attention latent normalization epsilon
#6204 opened Aug 3, 2026 by buptzyb Contributor Loading…
2
[FSDP] Reject post-wrap load_state_dict(assign=True) in MFSDP V2 community-request
#6203 opened Aug 3, 2026 by chengcuiping • Draft
4 of 6 tasks
1
6
Fix GTP embedding prefetch buffer reuse ordering complexity: low nemotron
#6202 opened Aug 3, 2026 by JF-D Contributor Loading…
1 task done
@JF-D
7
[feat] Add reduce-scatter-with-fp32-accumulation support for GTP complexity: medium nemotron
#6200 opened Aug 2, 2026 by fanshiqing Member Loading…
6 tasks done
1
@fanshiqing
6
[Prototype] Support MFSDP v2 recompute and 1F1B overlap
#6197 opened Aug 2, 2026 by shjwudp Contributor • Draft
1
Add inference state handoff support
#6196 opened Aug 1, 2026 by nvcsathe Contributor • Draft
6 tasks
1
Add configurable server evaluation defaults
#6195 opened Aug 1, 2026 by nvcsathe Contributor • Draft
6 tasks
1
[DO NOT MERGE] GTP+Muon rebased onto main for testing
#6194 opened Aug 1, 2026 by deepakn94 Contributor • Draft
1
feat(inference): Nemotron Omni multimodal support on the dynamic path
#6193 opened Aug 1, 2026 by shanmugamr1992 Contributor • Draft
9 tasks
1
Support layer-wise distributed optimizers in MIMO
#6192 opened Aug 1, 2026 by yashaswikarnati Contributor • Draft
1
Handle padding-only distributed optimizer checkpoint shards
#6191 opened Aug 1, 2026 by yashaswikarnati Contributor • Draft
1
Replace lazy MFSDP context initialization with an explicit scope complexity: medium Run tests
#6190 opened Aug 1, 2026 by wujingyue Contributor Loading…
3 of 6 tasks
4
Allocate main_grad on the reduce-scatter stream complexity: low Final Review PR is in the "final review" stage Run tests
#6187 opened Aug 1, 2026 by wujingyue Contributor Loading…
1
Document MFSDP optimizer design docs-only documentation only (docs or docstrings) Final Review PR is in the "final review" stage
#6186 opened Aug 1, 2026 by wujingyue Contributor Loading…
1
Fuse DSv4 output inverse RoPE into CSA sparse-attn Functions
#6185 opened Jul 31, 2026 by ghadiaravi13 • Draft
6 tasks
1
[TE/PTQ] Checkpoint FP32 global scaling factors for all quantized activations and weights. complexity: medium enhancement New feature or request
#6183 opened Jul 31, 2026 by cspades Member Loading…
6 tasks
@cspades
1
Revert "Add Agent Compose package and runtime interface skeleton"
#6179 opened Jul 31, 2026 by Phlip79 Member Loading…
3
[Dev] Allow FP8/FP4 with AbsorbedMLA up-projection recompute
#6178 opened Jul 31, 2026 by niyunsheng Loading…
7
[Dev] Prefetch FSDP weights for selective MLA recompute
#6176 opened Jul 31, 2026 by lhb8125 Contributor • Draft
1
[Dev] Fix FSDP forward prefetch in combined 1F1B
#6174 opened Jul 31, 2026 by lhb8125 Contributor • Draft
1
[Dev] Account for Qwen3.5 vision encoder FLOPs
#6173 opened Jul 31, 2026 by BestJuly Contributor Loading…
1
fix(ci): align workflow Python version with requires-python community-request waiting-on-maintainers Waiting on maintainers to respond
#6171 opened Jul 31, 2026 by MGPOCKY Loading…
3 tasks
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.