[https://nvbugs/6681216][infra] Waive DeepSeek V3 Lite NIXL on B200 and B300 - #18325
Conversation
…nd B300 Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
Included review availability: Your plan provides up to 12 included reviews per hour; 11 remain after this review. WalkthroughThe integration test waiver list now skips the DeepSeek V3 Lite FP8 NIXL disaggregated-serving test on DGX B200 and DGX B300. Both entries reference NVBug 6681216. ChangesTest waivers
Estimated code review effort: 1 (Trivial) | ~2 minutes Merge Risk: ⚪ Minimal · up to This change narrowly waives the affected Blackwell test while preserving H100 coverage, and the listed validation checks pass. No actionable merge-blocking risk remains after normal review. Possibly related PRs
Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Full details: Description checkExplanation The description clearly explains the failure, affected platforms, scope of the waiver, tracking bug, retained H100 coverage, and validation results. It does not use the template's exact Test Coverage or PR Checklist headings, but it provides the relevant test and validation information and is otherwise complete. Full details: Docstring CoverageExplanation No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (1 skipped: 1 unsupported.) ✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
/bot skip --comment "Test waiving only" |
|
PR_Github #69815 [ skip ] triggered by Bot. Commit: |
|
PR_Github #69815 [ skip ] completed with state |
Description
Temporarily waive the following test on DGX B200 and DGX B300 while keeping its H100 coverage active:
disaggregated/test_disaggregated.py::test_disaggregated_deepseek_v3_lite_fp8_nixl[DeepSeek-V3-Lite-fp8]On both Blackwell platforms, the workers remain at 0/2 registered while the logs reach Blackwell JIT and
Running autotuner warmup.... The harness then raisesTimeoutError: Timeout after 300s waiting for _checkbefore inference or KV transfer begins.The same failure was observed on main in L0_PostMerge #2933. In the CI history inspected after PR #17792 enabled this existing test on Blackwell, all 23 executed B200/B300 records failed and none passed; 12 additional records were skipped on stale branches. PR #17792 is the test-exposure boundary, but is not proven to have introduced the underlying startup problem.
This startup failure is tracked by NVBUG 6681216. It is separate from the KV-transfer timeout addressed by PR #17137 / NVBUG 6480621 and from the earlier host OOM addressed by PR #18185.
Validation
python scripts/check_test_list.py --check-duplicate-waives --validategit diff --checkBoth checks pass. The test-list validator checked 1,944 unique entries and found no duplicate waivers.
Dev Engineer Review
test_disaggregated_deepseek_v3_lite_fp8_nixl[DeepSeek-V3-Lite-fp8]on DGX B200 and DGX B300.git diff --checkpassed.QA Engineer Review
tests/integration/test_lists/waives.txt.test-db/orqa/files were modified.Verdict: needs follow-up