feat(attention): add output gating to absorbed MLA

b9c36e0

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

DCO

DCO

Mirror Dev to Main on: push 2

cherry-pick-to-main

Copyright check on: push 3

pre-flight / pre-flight

copyright-check / main

copyright-check-summary

Installation Test on: push 2

pre-flight / pre-flight

Pip - Python3.12 - AMD64/Linux - NGC PyTorch

UV - Python3.12 - AMD64/Linux - NGC PyTorch

Install test summary

CICD Megatron-LM on: push 167

ephemeral-runner-routing / resolve

merge-queue-notification

DCO

is-not-external-contributor

pre-flight / pre-flight

configure

linting

cicd-wait-in-queue

cicd-parse-downstream-testing

cicd-container-build / cicd-compute-build-matrix

cicd-container-build / Build CI container (aws-h100)

cicd-container-build / Build CI container (gb-gpu)

cicd-mbridge-testing

cicd-parse-unit-tests

cicd-parse-unit-tests-gb200

cicd-mbridge-testing-notify

tests/unit_tests/test_model_configs.py - latest

tests/unit_tests/test_fp8_param.py - latest

tests/unit_tests/pipeline_parallel/**/*.py - latest

tests/unit_tests/models/**/*.py - latest

tests/unit_tests/data/**/*.py - latest

tests/unit_tests/dist_checkpointing/test_optimizer.py - latest

tests/unit_tests/dist_checkpointing/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/**/*.py - latest

tests/unit_tests/dist_checkpointing/models/test_moe_experts.py - latest

tests/unit_tests/transformer/experimental_attention_variant/test_dsv4_hybrid_attention_cp_cuda_graph.py - latest

tests/unit_tests/transformer/**/*.py - latest

tests/unit_tests/inference/engines/test_dynamic_engine.py - latest

tests/unit_tests/inference/test_hybrid_moe.py - latest

tests/unit_tests/inference/**/*.py - latest

tests/unit_tests/rl/**/*.py - latest

tests/unit_tests/post_training/**/*.py - latest

tests/unit_tests/resharding/**/*.py - latest

tests/unit_tests/ssm/gated_delta_net/test_gdn.py - latest

tests/unit_tests/ssm/gated_delta_net/test_gdn_fusion.py - latest

tests/unit_tests/ssm/gated_delta_net/test_gdn_parallel.py - latest

tests/unit_tests/ssm/**/*.py - latest

tests/unit_tests/transformer/moe/**/*.py - latest

tests/unit_tests/distributed/mfsdp_v1/**/*.py - latest

tests/unit_tests/distributed/mfsdp_v2/**/*.py - latest

tests/unit_tests/a2a_overlap/**/*.py - latest

tests/unit_tests/determinism/correctness/**/*.py - latest

tests/unit_tests/**/*.py - latest

tests/unit_tests/transformer/test_multi_latent_attention.py - latest

tests/unit_tests/transformer/test_multi_token_prediction.py - latest

examples/multimodal_dev/tests/**/*.py - latest

tests/unit_tests/transformer/experimental_attention_variant/test_dsv4_hybrid_attention_cp_cuda_graph.py - gb200 latest

tests/unit_tests/**/*.py - gb200 latest

cicd-integration-gate

cicd-parse-integration-tests-h100

cicd-parse-integration-tests-gb200

gpt/gpt3_mcore_te_tp1_pp2_dsv4_hybrid_mhc_mtp - latest

gpt/gpt3_mcore_te_tp1_pp4_vp1_dist_optimizer_overlap_grad_reduce_param_gather_overlap_optimizer - latest

gpt/gpt3_mcore_te_tp2_pp1_cp4_dcp - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn_no_nvrx_async - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn_no_nvrx_async_mcore - latest

gpt/gpt3_mcore_te_tp2_pp1_gdn_no_nvrx_sync - latest

gpt/gpt3_mcore_te_tp2_pp2_dsa - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce_param_gather - latest

gpt/gpt3_mr_mcore_te_tp1_pp2_core_attn_offload_attn_cudagraph - latest

hybrid/hybrid_mr_mcore_te_tp1_pp2_mhc_core_attn_offload_attn_cudagraph - latest

gpt/gpt3_mcore_te_tp1_pp1_resume_torch_dist_dist_optimizer_1node - latest

gpt/gpt3_mcore_te_tp4_pp1_resume_torch_dist_dist_optimizer_overlap_grad_reduce_param_gather_1node - latest

moe/deepseek_proxy_fsdp_ep2_fsdp2_1node - latest

moe/gpt3_moe_mcore_te_ep8_resume_torch_dist_muon_1node - latest

Nemo_CICD_Test

Coverage_Fake

Coverage (unit-test)

Request NVSkills CI on: push 1

Build, validate, and release Megatron-Core on: push 20

pre-flight / pre-flight

bump / check-admin-permission

bump / bump-next-version

build-test-publish-wheels / build-and-test-wheels (megatron-core, arm64, quay.io/pypa/manylinux_2_28_aarch64)

build-test-publish-wheels / build-and-test-wheels (megatron-core, amd64, quay.io/pypa/manylinux_2_28_x86_64)

build-test-publish-wheels / build-and-test-wheels (megatron-fsdp, quay.io/pypa/manylinux_2_28_x86_64, amd64)

build-test-publish-wheels / publish-wheels (megatron-core, arm64)

build-test-publish-wheels / publish-wheels (megatron-core, amd64)

build-test-publish-wheels / publish-wheels (megatron-fsdp, amd64)

finalize / create-gh-release

finalize / build-docs / Build docs

finalize / notify

finalize / publish-docs

release-summary

Claude Complexity Label on: pull_request_target 4

Check PR Author Permission

Analyze PR Complexity

Apply PR Complexity Label

Review Trigger on: pull_request_review

signal

Review Trigger on: pull_request_review

signal

DCO / DCO succeeded Oct 10, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO

Loading

Re-running checks...