Skip to content

test(interop): qualify Python and TypeScript reporting artifacts across stable and skew #1199

Description

@bokelley

Summary

Add the blocking real-process Python/TypeScript stable-and-skew interoperability matrix required before the Reliable Reporting release can merge and publish.

The matrix must qualify immutable installed artifacts, not source checkouts, PR heads, mutable tags, or announcement metadata. The corrected TypeScript implementation from adcontextprotocol/adcp-client#2972 must first be published and identified exactly; the final Python candidate must include accepted rc.4 adoption and #1172.

Required matrix

  • Four pinned cells crossing the stable and candidate Python artifacts with the stable and corrected-candidate TypeScript artifacts.
  • An installed PostgreSQL-backed Python reference seller exercised over real MCP HTTP by the pinned JavaScript CLI.
  • Semantic reconcileReporting() assertions, not snapshot-only or schema-only checks.
  • Managed Delivery and Reconciled Billing status/receipt flows, signed webhook retry/replay, account activity, exact revision reads, and deterministic fixture identity.
  • A fresh process and isolated database/state per cell; do not share a long-running storyboard context across cells.
  • Exact package versions, registry URLs, integrity/hashes, protocol tag/source, runtime versions, commands, results, and retained logs for every cell.
  • Stable compatible lanes are blocking. Separately labeled latest canaries remain visible but non-blocking.

Acceptance criteria

  • Matrix refuses mutable, unpublished, mismatched, or source-only inputs.
  • All four required cells run back-to-back from clean installed environments and pass.
  • Failure in any required assertion or cell propagates to one required aggregate check.
  • Cross-cell state leakage is prevented and regression-tested.
  • Evidence identifies the exact accepted Python and TypeScript artifacts and protocol rc.4 source.
  • Matrix is rerun on the final integrated Python main commit and again where required for the release-PR merge commit.

Ordering

Harness preparation and baseline runs may proceed in parallel. Final blocking acceptance waits for the published corrected TypeScript artifact, accepted Python rc.4 replacement, complete #1172, and the reviewed release guard.

Related: #1172, #1193, #1198, adcontextprotocol/adcp-client#2972, adcontextprotocol/adcp#7574.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions