Skip to content

Add NVX Phase 3d direct launch executor - #8870

Merged
lpcox merged 2 commits into
mainfrom
nvx-phase-3d-launch-executor
Sep 22, 2026
Merged

lpcox merged 2 commits into
mainfrom
nvx-phase-3d-launch-executor

Conversation

@lpcox

@lpcox lpcox commented Sep 22, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • replace the unusable flat nvx.py artifact contract with a commit-pinned, three-artifact direct OpenVMM launch path
  • add a production internal executor that gates Bubblewrap startup, assigns the launcher/sandbox to the run cgroup, identifies OpenVMM by device/inode, verifies confinement while the VM is paused, then performs the pinned TERM=dumb Ctrl-Q/REPL-prompt resume handshake
  • install an explicit x86_64 cBPF seccomp denylist through Bubblewrap FD 5 and clear the inherited environment before OpenVMM starts
  • use no-TAP Consomme networking with matching default-deny OpenVMM and namespace nftables endpoint allowlists
  • keep NVX unavailable through CLI/runtime registration until complete live guest evidence is accepted
  • update the opt-in KVM workflow to verify the pinned direct-launch ABI and record the remaining end-to-end guest boot evidence as blocked rather than claiming success

Security and compatibility details

  • OpenVMM executable identity is verified by device/inode because /proc/<pid>/exe exposes the in-jail path across the Bubblewrap mount namespace
  • host VMM cgroup PID capacity is independent from the guest workload PID limit
  • the direct argv omits the invalid infrastructure-address --network-proxy usage and the catch-all deny rule that would override endpoint allows
  • timeout and cancellation terminate both known processes and the complete cgroup/process group
  • artifact manifest schema advances to v2 with only OpenVMM, kernel, and initramfs

Validation

  • npm test -- --runInBand — 380 suites passed, 6,087 tests passed, 4 skipped
  • npm run build
  • npm run type-check
  • npm run lint -- --quiet
  • npx markdownlint-cli2 docs/nvx-security-design.md
  • workflow YAML parse validation

Remaining promotion evidence

This PR intentionally does not register an nvx runtime. Promotion still requires a live GitHub-hosted x86_64 KVM run proving complete guest boot/exit, Copilot API-proxy inference, adversarial network and filesystem denial, timeout/cancellation cleanup, stale recovery, and concurrent-run isolation.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings September 22, 2026 04:40
@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Documentation Preview

Documentation has been built for this PR.

Download preview artifact

To view locally:

  1. Download the docs-preview-pr-8870 artifact from the workflow run
  2. Unzip and open index.html in your browser

Built from commit 3e0d5b8

@github-actions

Copy link
Copy Markdown
Contributor

⚠️ Coverage Regression Detected

This PR decreases test coverage. Please add tests to maintain coverage levels.

Overall Coverage

Metric Base PR Delta
Lines 92.12% 92.01% 📉 -0.11%
Statements 90.66% 90.50% 📉 -0.16%
Functions 90.19% 89.92% 📉 -0.27%
Branches 84.08% 83.80% 📉 -0.28%
📁 Per-file Coverage Changes (8 files)
File Lines (Before → After) Statements (Before → After)
src/nvx/preflight.ts 64.9% → 64.6% (-0.31%) 63.8% → 63.5% (-0.32%)
src/nvx/runtime-lifecycle.ts 84.1% → 84.0% (-0.13%) 78.2% → 78.7% (+0.46%)
src/nvx/manager.ts 82.1% → 82.1% (+0.00%) 81.5% → 82.0% (+0.54%)
src/microvm/network-manager.ts 98.6% → 98.7% (+0.04%) 97.4% → 97.4% (+0.07%)
src/nvx/confinement.ts 88.0% → 88.2% (+0.15%) 83.1% → 83.3% (+0.20%)
src/microvm/network-plan.ts 93.1% → 93.3% (+0.21%) 92.5% → 92.7% (+0.22%)
src/nvx/one-shot-adapter.ts 80.4% → 80.7% (+0.29%) 77.7% → 78.0% (+0.34%)
src/log-directory-setup.ts 96.2% → 100.0% (+3.78%) 96.3% → 100.0% (+3.71%)
✨ New Files (1 files)
  • src/nvx/launch-executor.ts: 85.8% lines

Coverage comparison generated by scripts/ci/compare-coverage.ts

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟡 Changes recommended

The executor can miss an early child exit and hang indefinitely while awaiting a non-replayed process event.

Get a fresh assessment by requesting another Copilot review.

Review effort: Balanced
Findings: 1 High severity

Open (1)
What changed in this PR

Adds the internal NVX Phase 3d direct OpenVMM launch path while keeping NVX unavailable as a selectable runtime.

Changes:

  • Replaces the nvx.py launcher and four-artifact contract with direct OpenVMM execution and three artifacts.
  • Adds gated startup, confinement verification, seccomp filtering, cgroup control, and no-TAP networking.
  • Updates tests, security documentation, and the opt-in KVM validation workflow.
File Description
src/​nvx/​runtime-lifecycle.ts Builds direct OpenVMM launch plans and arguments.
src/​nvx/​runtime-lifecycle.test.ts Tests direct launch planning.
src/​nvx/​preflight.ts Removes Python/TUN requirements and snapshots three artifacts.
src/​nvx/​preflight.test.ts Updates preflight coverage for schema v2.
src/​nvx/​one-shot-adapter.ts Extracts reusable execution preparation and result handling.
src/​nvx/​manager.ts Wires the production direct-launch executor.
src/​nvx/​manager.test.ts Tests manager integration and launch hooks.
src/​nvx/​launch-executor.ts Implements gated direct OpenVMM execution.
src/​nvx/​launch-executor.test.ts Tests readiness, failure, timeout, and cancellation paths.
src/​nvx/​index.ts Exports the new NVX APIs.
src/​nvx/​confinement.ts Adds Bubblewrap FD controls and executable identity verification.
src/​nvx/​confinement.test.ts Tests updated confinement behavior.
src/​nvx/​artifact-manifest.ts Advances the artifact manifest to schema v2.
src/​nvx/​artifact-manifest.test.ts Updates manifest validation coverage.
src/​microvm/​network.test.ts Tests no-TAP namespace networking.
src/​microvm/​network-types.ts Adds TAP creation controls.
src/​microvm/​network-plan.ts Generates no-TAP output filtering rules.
src/​microvm/​network-manager.ts Skips TAP and forwarding setup when disabled.
docs/​nvx-security-design.md Documents the Phase 3d security boundary.
.github/​workflows/​nvx-phase-3b-live-kvm.yml Updates opt-in direct-launch validation.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread src/nvx/launch-executor.ts Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor

✅ Copilot review passed with no inline comments.

@lpcox Add the ready-for-aw label to this PR to trigger agentic CI smoke tests.

@github-actions

Copy link
Copy Markdown
Contributor

⚠️ Coverage Regression Detected

This PR decreases test coverage. Please add tests to maintain coverage levels.

Overall Coverage

Metric Base PR Delta
Lines 92.13% 92.01% 📉 -0.12%
Statements 90.67% 90.50% 📉 -0.17%
Functions 90.19% 89.92% 📉 -0.27%
Branches 84.09% 83.80% 📉 -0.29%
📁 Per-file Coverage Changes (8 files)
File Lines (Before → After) Statements (Before → After)
src/nvx/one-shot-adapter.ts 81.0% → 80.7% (-0.32%) 78.2% → 78.0% (-0.23%)
src/nvx/preflight.ts 64.9% → 64.6% (-0.31%) 63.8% → 63.5% (-0.32%)
src/nvx/runtime-lifecycle.ts 84.1% → 84.0% (-0.13%) 78.2% → 78.7% (+0.46%)
src/nvx/manager.ts 82.1% → 82.1% (+0.00%) 81.5% → 82.0% (+0.54%)
src/microvm/network-manager.ts 98.6% → 98.7% (+0.04%) 97.4% → 97.4% (+0.07%)
src/nvx/confinement.ts 88.0% → 88.2% (+0.15%) 83.1% → 83.3% (+0.20%)
src/microvm/network-plan.ts 93.1% → 93.3% (+0.21%) 92.5% → 92.7% (+0.22%)
src/log-directory-setup.ts 96.2% → 100.0% (+3.78%) 96.3% → 100.0% (+3.71%)
✨ New Files (1 files)
  • src/nvx/launch-executor.ts: 85.8% lines

Coverage comparison generated by scripts/ci/compare-coverage.ts

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Copilot BYOK completed. Copilot BYOK mode operational. 🔓

🔑 BYOK report filed by Smoke Copilot BYOK

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Gemini reports failed. Facets need polishing...

💎 Faceted by Smoke Gemini

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

📰 BREAKING: Report filed by Smoke Copilot

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

🛡️ Smoke Copilot Network Isolation confirmed the egress allowlist is enforced. ✅

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • example.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "example.com"

See Network Configuration for more information.

🛡️ Egress verdict from Smoke Copilot Network Isolation

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Claude passed

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by Smoke Claude for #8870

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Copilot BYOK AOAI (Entra) reports failed. AOAI BYOK (Entra) mode investigation needed...

🪪 BYOK (AOAI Entra) report filed by Smoke Copilot BYOK AOAI (Entra)

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

Warning

Firewall blocked 8 domains

The following domains were blocked by the firewall during workflow execution:

  • accounts.google.com
  • android.clients.google.com
  • clients2.google.com
  • contentautofill.googleapis.com
  • msfeed25.pkgs.visualstudio.com
  • update.googleapis.com
  • www.google.com
  • www.gstatic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "accounts.google.com"
    - "android.clients.google.com"
    - "clients2.google.com"
    - "contentautofill.googleapis.com"
    - "msfeed25.pkgs.visualstudio.com"
    - "update.googleapis.com"
    - "www.google.com"
    - "www.gstatic.com"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Chroot tests passed! Smoke Chroot - All security and functionality tests succeeded.

Tested by Smoke Chroot

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

🔌 Smoke Services — All services reachable! ✅

🔌 Service connectivity validated by Smoke Services

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Build Test Suite completed successfully!

Generated by Build Test Suite for #8870

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Cloud Hypervisor completed. Cloud Hypervisor + Copilot passed.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • example.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "example.com"

See Network Configuration for more information.

Cloud Hypervisor + Copilot smoke test by Smoke Cloud Hypervisor

@github-actions

Copy link
Copy Markdown
Contributor

🚀 Security Guard has started processing this pull request

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

📡 Smoke OTel Tracing completed. All tracing scenarios validated. ✅

📡 OTel tracing validated by Smoke OTel Tracing

@github-actions

github-actions Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Smoke Copilot BYOK AOAI (api-key) reports failed. AOAI BYOK (api-key) mode investigation needed...

🔑 BYOK (AOAI api-key) report filed by Smoke Copilot BYOK AOAI (api-key)

@github-actions

Copy link
Copy Markdown
Contributor

Smoke Test: Cloud Hypervisor + Copilot

  1. PASS - GitHub MCP list_pull_requests call succeeded
  2. PASS - https://github.com returned 200
  3. PASS - wrote/read /tmp/gh-aw/agent/smoke-cloud-hypervisor-${GITHUB_RUN_ID}.txt
  4. PASS - (example.com/redacted) blocked (000)

Result: ALL CHECKS PASSED

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • example.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "example.com"

See Network Configuration for more information.

Cloud Hypervisor + Copilot smoke test by Smoke Cloud Hypervisor
Add label ready-for-aw to run again

@github-actions github-actions Bot added the smoke-copilot-network-isolation Copilot network-isolation egress smoke test label Sep 22, 2026
@github-actions

Copy link
Copy Markdown
Contributor

EGRESS_RESULT allow=pass deny=pass

✅ Allowed domain (github.com) reachable — HTTP 200
✅ Blocked domain (example.com) denied — CONNECT tunnel 403

Overall status: PASS

@lpcox

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • example.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "example.com"

See Network Configuration for more information.

🛡️ Egress verdict from Smoke Copilot Network Isolation
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Smoke Test: Copilot Engine

Overall: PASS

cc @lpcox

📰 BREAKING: Report filed by Smoke Copilot
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Smoke Test: Claude Engine Validation

Check Status
API ✅ PASS
gh CLI ✅ PASS
File ✅ PASS

Overall result: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • api.anthropic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "api.anthropic.com"

See Network Configuration for more information.

Generated by Smoke Claude for #8870 · claude · haiku45 · 29.9 AIC · ⊞ 4.7K ·
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

✅ Smoke Test: Copilot BYOK (Direct Mode)

Test Results:

  • ✅ GitHub MCP Connectivity: PR list OK
  • ✅ GitHub.com HTTP: 200 OK
  • ✅ File Write/Read: Test file exists
  • ✅ BYOK Inference Path: api-proxy → api.githubcopilot.com

Mode: Direct BYOK (COPILOT_PROVIDER_API_KEY via api-proxy sidecar)

Status: PASS

🔑 BYOK report filed by Smoke Copilot BYOK
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Smoke Test: Services Connectivity

  • Redis PING: ✅ (PONG)
  • Postgres pg_isready: ✅ (accepting connections)
  • Postgres SELECT 1: ✅ (1)

Overall: PASS

🔌 Service connectivity validated by Smoke Services
Add label ready-for-aw to run again

@lpcox
lpcox deployed to aoai-model September 22, 2026 14:25 — with GitHub Actions Active
@github-actions

Copy link
Copy Markdown
Contributor

🏗️ Build Test Suite Results

Ecosystem Project Build/Install Tests Status
Bun elysia 1/1 passed ✅ PASS
Bun hono 1/1 passed ✅ PASS
C++ fmt N/A ✅ PASS
C++ json N/A ✅ PASS
Deno oak N/A 1/1 passed ✅ PASS
Deno std N/A 1/1 passed ✅ PASS
.NET hello-world N/A (ran OK) ✅ PASS
.NET json-parse N/A (ran OK) ✅ PASS
Go color 1/1 passed ✅ PASS
Go env 1/1 passed ✅ PASS
Go uuid 1/1 passed ✅ PASS
Java gson 1/1 passed ✅ PASS
Java caffeine 1/1 passed ✅ PASS
Node.js clsx passed ✅ PASS
Node.js execa passed ✅ PASS
Node.js p-limit passed ✅ PASS
Rust fd 1/1 passed ✅ PASS
Rust zoxide 1/1 passed ✅ PASS

Overall: 8/8 ecosystems passed — PASS

Note: For the Java tasks, ~/.m2 was pre-owned by root (not the runner user), causing an initial Could not create local repository error. Worked around by pointing <localRepository> in ~/.m2/settings.xml to a writable path (/tmp/gh-aw/agent/m2-repo); the Squid HTTP/HTTPS proxy settings were otherwise unchanged. All other ecosystems ran cleanly on the first attempt.

All 18 projects across all 8 ecosystems built/installed and passed their tests successfully with the AWF firewall's proxy configuration.

Generated by Build Test Suite for #8870 · copilot · auto · 39.1 AIC · ⊞ 11.8K ·
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Smoke Test: API Proxy OpenTelemetry Tracing — Results

# Scenario Result
1 Module Loading otel.js loaded; isEnabled(): true; exports startRequestSpan, setTokenAttributes, setBudgetAttributes, endSpan, endSpanError, shutdown, isEnabled + internal test hooks
2 Test Suite ✅ 3 test suites / 68 tests passed (otel.test.js, otel-fanout.test.js, otel-workload-identity.test.js)
3 Env Var Forwarding env-passthrough.ts forwards GITHUB_AW_OTEL_TRACE_ID/GITHUB_AW_OTEL_PARENT_SPAN_ID to the agent; api-proxy-env-config.ts's buildOtelEnv() forwards OTLP endpoint/headers, service name, and parent trace context to api-proxy
4 Token Tracker Integration onUsage callback present in token-tracker-http.js, invoked after normalized usage extraction as the OTEL hook point
5 OTEL Diagnostics ✅ Spans exported: top-level /tmp/gh-aw/otel.jsonl contains a workflow-level span (gh-aw.agent.setup) with correct trace/parent-span IDs. GH_AW_OTLP_ENDPOINTS/OTEL_EXPORTER_OTLP_ENDPOINT correctly pointed at the Sentry OTLP ingest endpoint. api-proxy processed 13 real Copilot chat-completion requests (token-usage.jsonl), confirming the tracing/token-usage pipeline was exercised end-to-end during this run

All 5 scenarios passed. No unexpected failures detected.

📡 OTel tracing validated by Smoke OTel Tracing
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Chroot Version Comparison Results

Runtime Host Version Chroot Version Match?
Python Python 3.12.14 Python 3.12.14 ✅ YES
Node.js v24.21.0 v22.23.2 ❌ NO
Go go1.22.12 go1.22.12 ✅ YES

Overall: FAILED — Node.js version mismatch between host and chroot environments. The smoke-chroot label was not added since not all tests passed.

Tested by Smoke Chroot
Add label ready-for-aw to run again

@github-actions

Copy link
Copy Markdown
Contributor

Merged PRs: feat(nvx): add internal Phase 3c lifecycle manager; Correlate upstream 400s with request tool surface and negotiate MCP protocol version
Retrieved PRs: Upgrade gh-aw workflows to latest pre-release; fix(security): enforce TLS SNI allowlist
Playwright: ✅
File write: ✅
Bash readback: ✅
Discussion comment: ✅
Build AWF: ✅
Overall: PASS

Warning

Firewall blocked 8 domains

The following domains were blocked by the firewall during workflow execution:

  • accounts.google.com
  • android.clients.google.com
  • clients2.google.com
  • contentautofill.googleapis.com
  • msfeed25.pkgs.visualstudio.com
  • update.googleapis.com
  • www.google.com
  • www.gstatic.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "accounts.google.com"
    - "android.clients.google.com"
    - "clients2.google.com"
    - "contentautofill.googleapis.com"
    - "msfeed25.pkgs.visualstudio.com"
    - "update.googleapis.com"
    - "www.google.com"
    - "www.gstatic.com"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex
Add label ready-for-aw to run again

@lpcox
lpcox merged commit de8b24c into main Sep 22, 2026
154 of 159 checks passed
@lpcox
lpcox deleted the nvx-phase-3d-launch-executor branch September 22, 2026 14:50

This branch was successfully deployed

1 active deployment
aoai-model f337f5a7 Deployed Sep 22, 2026 by lpcox via conclusion #1732
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants