Skip to content

Neighbor probe: ProofPR → CounterProof → Fowlcon as a reviewer evidence chain? #31

Description

@hippoley

This is a collaboration probe, not a proposal that any project should absorb another one.

Verified neighbors:

The useful question is whether one small claim/evidence artifact can move between these review stages without any tool taking authority it does not own.

1. ProofPR — PR intake / evidence presence

ProofPR is a deterministic PR triage gate. It already has first-class:

  • EvidenceContract
  • EvidenceRequirement
  • EvidenceScore
  • ReviewDecision (ready / review-carefully / needs-evidence / block-merge)
  • JSON output

Important correction to the earlier wording: ProofPR does not currently have a generic external CounterProof-receipt ingestion path. Its evidence contracts currently infer signals such as verification, reproduction, screenshot, changelog, and permission-rationale from PR text/diff/test signals.

So the real interoperability question is narrower:

when ProofPR requires verification, can an auditable external executable receipt strengthen or satisfy that requirement without turning ProofPR into an execution engine?

2. CounterProof — what does the executable evidence actually establish?

CounterProof keeps evidence scope explicit:

claim                         evidence                 status
original regression           BASE fail / HEAD pass   WITNESSED (submitted judge)
atomic write durability       no exercising test      UNPROVEN
product oracle disagrees      product probe           CONTRADICTED

It carries candidate SHAs, exact tests/probes, provenance, digest, and scope limits. It does not decide whether a PR is ready for review or whether the PR should merge.

3. Fowlcon — reviewer comprehension

Fowlcon organizes a PR into concepts and keeps human reviewer states separate (pending / reviewed / accepted). Its Description Verification section already has Claim | Status | Evidence.

The possible chain is therefore:

ProofPR
  "is enough review evidence present to spend maintainer time?"
        ↓
CounterProof
  "what does this executable evidence actually prove?"
        ↓
Fowlcon
  "present the claims and code in a human review walkthrough"
        ↓
human judgment

What not to build yet

  • no shared runtime
  • no integration SDK
  • no aggregate cross-tool score
  • no automatic approve/reject
  • no new Fowlcon status vocabulary

Smallest Reality Probes

ProofPR

Take one existing Evidence Contract requiring verification. Compare:

  1. PR prose merely says tested;
  2. PR carries a CounterProof receipt bound to exact HEAD, exact test, BASE/HEAD result, digest, and scope limit.

Ask whether case 2 should change ProofPR's intake decision or evidence explanation.

Fowlcon

On one real PR, attach one CounterProof receipt to one existing description claim/concept. Measure whether the reviewer avoids repeating an evidence check without confusing executable evidence with reviewed / accepted.

If either experiment produces no real review benefit, we should stop rather than build adapters.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions