Skip to content

[None][infra] Waive 15 failed cases for main in post-merge 2920 - #18048

Merged
mzweilz merged 2 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260821-025132
Aug 21, 2026
Merged

[None][infra] Waive 15 failed cases for main in post-merge 2920#18048
mzweilz merged 2 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260821-025132

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @mzweilz)
Target branch: main
Bug(s): 6644448, 6644450, 6644453, 6644459, 6644462, 6644465, 6644468, 6644472, 6644475, 6644477, 6644478, 6644479, 6644482, 6644487, 6644489

Waive entries added

accuracy/test_disaggregated_serving.py::TestLlama3_1_8BInstruct::test_tp_pp_symmetric[GSM8K-tp2pp1] SKIP (https://nvbugs/6644475)
accuracy/test_disaggregated_serving.py::TestNemotron3Super120B::test_auto_dtype[mtp_nextn=0-block_reuse=False-use_py_transceiver=True] SKIP (https://nvbugs/6644482)
accuracy/test_dwdp_aggregated.py::TestDwdpAggDeepSeekV3Lite::test_dwdp_agg_accuracy[mode_a_uniform_contention_opt] SKIP (https://nvbugs/6644489)
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_eagle3_4gpus[v2_kv_cache-cutlass-one_model-no_overlap_scheduler] SKIP (https://nvbugs/6644462)
accuracy/test_llm_api_pytorch.py::TestNemotronV3Super::test_nvfp4_4gpus_hopper_w4a16 SKIP (https://nvbugs/6644472)
disaggregated/test_auto_scaling.py::test_disagg_server_restart[http-round_robin] SKIP (https://nvbugs/6644468)
examples/visual_gen/test_visual_gen_glm.py::test_glm_image_feature_accuracy_against_golden[nvfp4] SKIP (https://nvbugs/6644450)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-b200_deepseek-r1-fp4_8k1k_con1536_ctx1_dep4_gen1_dep8_eplb0_mtp1_ccb-NIXL] SKIP (https://nvbugs/6644487)
unittest/_torch/modules/moe/test_moe_backend.py::test_moe_backend -k "CUTEDSL" SKIP (https://nvbugs/6644448)
unittest/_torch/modules/moe/test_moe_backend.py::test_moe_backend -k "MEGAMOE_CUTEDSL" SKIP (https://nvbugs/6644453)
unittest/_torch/modules/moe/test_moe_module.py::test_configurable_moe_multi_gpu -k "CUTEDSL" SKIP (https://nvbugs/6644459)
unittest/_torch/modules/moe/test_moe_module.py::test_configurable_moe_multi_gpu[parallel=DEP-comm=IGNORE-e8_k1_h512_i512-seq=8-dtype=torch.bfloat16-backend=MEGAMOE_CUTEDSL-quant=NVFP4-routing=DeepSeekV3] SKIP (https://nvbugs/6644479)
unittest/_torch/modules/moe/test_moe_module.py::test_configurable_moe_multi_gpu_eplb -k "MEGAMOE_CUTEDSL" SKIP (https://nvbugs/6644478)
unittest/_torch/modules/moe/test_moe_module.py::test_configurable_moe_multi_gpu_eplb[parallel=DEP-comm=IGNORE-e8_k2_h512_i512-seq=8-dtype=torch.bfloat16-backend=MEGAMOE_CUTEDSL-quant=NVFP4-routing=Renormalize-slots=16-eplb=dynamic] SKIP (https://nvbugs/6644477)
unittest/_torch/visual_gen/multi_gpu/test_wan_pipeline_parallel.py::TestWanPipelineParallel::test_cfg2_attn2d2x1_ulysses2_pvae8 SKIP (https://nvbugs/6644465)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • tests/integration/test_lists/waives.txt adds 15 SKIP entries.
  • Each entry includes an NV bug reference.
  • The change is limited to test waivers.
  • No exported or public entities changed.
  • The waiver format is consistent with the file.
  • No duplicate or unintended scope changes were identified.

QA Engineer Review

  • No test-db/ or qa/ files were modified.
  • The change adds 15 waivers for integration, accuracy, performance, MoE, and visual-generation tests.
  • CBTS coverage data is unavailable.
  • Verdict: needs follow-up.

Bug(s): 6644448, 6644450, 6644453, 6644459, 6644462, 6644465, 6644468, 6644472, 6644475, 6644477, 6644478, 6644479, 6644482, 6644487, 6644489
Requested by: @mzweilz

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
Signed-off-by: Abby Wei <18545893+mzweilz@users.noreply.github.com>
@coderabbitai

coderabbitai Bot commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: d52d96a6-24a1-4e13-8249-462d8e61a4e5

📥 Commits

Reviewing files that changed from the base of the PR and between d556198 and d282cc4.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Included review availability: Your plan provides up to 12 included reviews per hour; 11 remain after this review.


Walkthrough

Updated the integration test waiver list with skip entries for newly waived model, serving, accuracy, performance, MoE, and visual-generation tests. Each entry includes an NV bug reference.

Changes

Integration test waivers

Layer / File(s) Summary
Model test waivers
tests/integration/test_lists/waives.txt
Added waivers for symmetric Llama, Nemotron, Qwen, DWD P, GPT-OSS Eagle3, GLM image accuracy, and DeepSeek-R1 performance tests.
Serving and visual-generation waivers
tests/integration/test_lists/waives.txt
Added waivers for Qwen3.5 DFlash, disaggregated server restart, and Wan pipeline-parallel visual-generation tests.
MoE backend waivers
tests/integration/test_lists/waives.txt
Added waivers for CUTLASS, MegaMoE CUTEDSL, configurable multi-GPU MoE, and dynamic EPLB MoE tests.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Merge Risk: 🔵 Low · up to d282c

The PR adds a waiver whose bug ID does not match the stated 15-bug scope, which could suppress an unrelated post-merge failure. It is mergeable with explicit owner confirmation or removal of the extra waiver.

Possibly related PRs

Suggested reviewers: qijune, schetlur-nv

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies the infrastructure change, the 15 waived cases, the target branch, and the post-merge run.
Description check ✅ Passed The description explains the waiver purpose, target branch, bug references, and all 15 entries for this auto-generated infrastructure change.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (1 skipped: 1 unsupported.)
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@mzweilz

mzweilz commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive only"

@mzweilz
mzweilz enabled auto-merge (squash) August 21, 2026 02:58
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #68104 [ skip ] triggered by Bot. Commit: d282cc4 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #68104 [ skip ] completed with state SUCCESS. Commit: d282cc4
Skipping testing for commit d282cc4

Link to invocation

@mzweilz
mzweilz merged commit 1612e17 into NVIDIA:main Aug 21, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants