Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6521 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6521 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
Wohox and others added 28 commits February 12, 2026 05:49
@Wohox @dimapihtar
[Main] Fix EP Overlap Bugs for Full-Iter CG (#3164)
dedb6dd 
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
@maanug-nv
Avoid direct pickle import (#3375)
11a4659 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@Phlip79
Delete old pretrain_* files (#3359)
fe9279e
@xuwchen
Add Qwen3-VL support with Megatron-FSDP (#2841)
7df15bd
@santhnm2
Refactor Mamba chunked prefill (#3265)
c65fb25 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@jstjohn @ko3n1g
Improved parallel logging of learning rate (#3319)
47938af 
Co-authored-by: oliver könig <okoenig@nvidia.com>
@lmcafee-nvidia @claude
Add enhanced event tracking with TTFT measurement and compact seriali…
a51c1c8 
…zation. (#3253)

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
@santhnm2
Add assertion that max_requests is divisible by tp_size (#3304)
dbc444f 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ArEsKay3 @ISEEKYAN
@sidsingh-nvidia @ko3n1g @tdene
Move to using the Inference OpenAI API server (#3107)
1123fc0 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
@ko3n1g
Revert "Move to using the Inference OpenAI API server (#3107)"
4184bfa 
This reverts commit 1123fc0.
@Victarry @cursoragent @Phlip79
Update moe github test cases. (#3077)
9119fae 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@ko3n1g
Revert "Update moe github test cases. (#3077)"
e0aa16b 
This reverts commit 9119fae.
@nschank @ko3n1g @yashaswikarnati
Split layer_specs to return Submodules instead of ModuleSpecs (#3255)
28ccdaa 
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
@chtruong814
ci: Remove gpu sanity check (#3420)
76a9f47 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@kevalmorabia97
[Critical-Bug] Fix Uneven PP for Mamba models (Nemotron3-nano) (#3399)
d10eb6f 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
@shanmugamr1992
Fix for rl (#3390)
2611830
@vasunvidia
Add check for full_iteration scope before instantiating CudaGraphMana…
4578ed8 
…ger (#3362)
@megnvidia @Phlip79
Fix broken links throughout (#3230)
698feec 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
@sajadn
Extract intermediate embeddings of transformer block (#3060)
d401490 
Signed-off-by: sajadn <snorouzi@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
545bff9
@kunlunl @laixinn
Decouple topk and loss from DSA Indexer (#3248)
b890099 
Co-authored-by: xielaixin <xielx@shanghaitech.edu.cn>
@tdene @ISEEKYAN
@sidsingh-nvidia @ArEsKay3 @ko3n1g
Move to using the Inference OpenAI API server (bis) (#3395)
7a8f305 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Yan Bai <baiyan1996@icloud.com>
Co-authored-by: Siddharth Singh <sidsingh@nvidia.com>
Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Robert Kirby <rkirby@nvidia.com>
Co-authored-by: Robert Kirby <ArEsKay3@users.noreply.github.com>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@santhnm2
Make Mamba inference state memory ratio configurable (#3322)
4beb8ca 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@tdene
Fix configs for RL model environments (#3441)
cbb47c8
@tdene @yobibyte
Replace pickle with json in rl_utils (#3351)
8f1c2f8 
Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>
@dndnda
fix: correct typo in demo training example (#3428)
057c804 
Co-authored-by: liming127 <liming127@meituan.com>
@tdene
Clean up logging inside inference flask server (#3437)
b218e64
@chtruong814
ci: Update release-docs workflow to use FW-CI-templates v0.72.0 (#3438)
3c69780 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
tdene and others added 30 commits March 12, 2026 14:40
@tdene @santhnm2
Fix if statement in main (#3833)
5b25326 
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
@ko3n1g
Update golden values of weekly tests (#3829)
6657173 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
build: Loosen TE restriction (#3827)
4736aed 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g @salmanmkc
Upgrade GitHub Actions for Node 24 compatibility (#3830)
1d5e68b 
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
@tdene
Do not let chunked prefill generate decode logprobs (#3777)
46227e0
@tdene
Prevent double serialization inside Flask server (#3653)
e08dc9d
@tdene
Allow RL to run inference-only via skip-train (#3744)
29e798a
@ko3n1g
Announce Python 3.12 migration (#3825)
4c1d0e4 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
fabbcdf
@chtruong814
ci: Skip test_wrong_cuda_graph_impl_returns_false in LTS (#3847)
b250472 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@chtruong814
ci: Mark TestCoordinator.test_throughput as flaky (#3849)
7ca9dc5 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@dimapihtar
find optimal number of workers (#3699)
f261906 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@dimapihtar
remove encoder_and_decoder (#3836)
b7437fe 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@chtruong814
ci: Skip more tests in test_vision_cuda_graphs for LTS (#3860)
8a806e5 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@mathemakitten
Ensure that inference dummy_forward does not try to match on a cudagr…
90fee1f 
…aph when running eager (#3815)
@santhnm2 @shanmugamr1992
Add unit tests for speculative decoding (#3817)
d1b8e27 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>
@tdene
Fix flakiness due to timing between shutdowns (#3857)
d4ac04f
@huvunvidia
Exposing interleave argument for fused_apply_rotary_pos_emb_thd (#3794)
87eb3c2
@ko3n1g @claude @chtruong814
ci: install nvidia-resiliency-ext from source (#3861)
9a19203 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
@santhnm2
Miscellaneous inference bug fixes (#3840)
f8becec 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@sidsingh-nvidia @claude
Nemo-RL integration bugfixes for --transformer-impl inference_optimiz…
905c0e3 
…ed (#3851)

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
@github-actions
chore(beep boop 🤖): Bump (main) (2026-03-16)
5dca153
@dimapihtar
remove legacy mpu (#3854)
b5b1994 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@dimapihtar
enable async save for functional tests (#3855)
086777a 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@dimapihtar
remove legacy data (#3853)
925341d 
Signed-off-by: dimapihtar <dpihtar@gmail.com>
@ko3n1g
docs: Document python-gitlab dependency (#3863)
8334576 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@gautham-kollu @ko3n1g
Fsdp dsv3 proxy (#3844)
9a494f1 
Signed-off-by: gkollu <gkollu@nvidia.com>
Signed-off-by: Gautham Kollu <gkollu@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@asolergi-nv
Fix token dispatched cudagraph_attrs (#3625)
feeb1b4
@tdene
Fix slowdown in serialization (#3872)
3b34761
@maanug-nv
Establish reviewers for training code (#3765)
c1a14fb 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.