FE-1505: Time each interviewer turn by purpose by lunelson · Pull Request #9347 · hashintel/hash

lunelson · 2026-08-26T17:16:41Z

🌟 What is the purpose of this PR?

Condition 5 measured about 145 seconds per interviewer turn without saying where the time goes. This branch attributes each model call, compaction, and repair to a harness purpose, emits privacy-safe server telemetry spans, and makes baseline timing runs kill-safe and bounded so the per-purpose split can be read from a short run or from the Proof 0 panel run.

Draft: opened so the stack is visible end to end. The description is completed when the branch is tied off.

🔗 Related links

FE-1505 (internal; owning issue)

🚫 Blocked by

Stacks on ln/fe-1506-legible-panel-status; lands after it.

🔍 What does this change?

Per-purpose turn timing in the Flue binding and the baseline runner; OpenTelemetry spans in the server; BRUNCH_BASELINE_HARD_STOP and incremental condition-5.timings.jsonl writes; run-specific timing evidence preserved.

Pre-Merge Checklist 🚀

🚢 Has this modified a publishable library?

This PR:

does not modify any publishable blocks or libraries, or modifications do not need publishing

📜 Does this require a change to the docs?

The changes in this PR:

are internal and do not require a docs change

vercel · 2026-08-26T17:16:53Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
hash	Ready	Preview	Aug 28, 2026 12:47pm
petrinaut	Ready	Preview	Aug 28, 2026 12:47pm
petrinaut-docs	Ready	Preview	Aug 28, 2026 12:47pm

1 Skipped Deployment

Project	Deployment	Actions	Updated (UTC)
hashdotdesign-tokens	Ignored	Preview	Aug 28, 2026 12:47pm

lunelson · 2026-08-26T17:19:21Z

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

cursor · 2026-08-26T17:19:49Z

PR Summary

Low Risk
Changes are mostly evaluation telemetry, test fixtures, and dev-server instrumentation with content suppressed; no auth or production data-path changes.

Overview
Adds per-purpose wall-clock attribution for condition 5 baseline runs: each Flue model call is tagged as interview, sweep, or repair (including refused-sweep retries and post-sweep compaction), written incrementally to condition-5.timings.jsonl, embedded in condition-5.raw.json, and summarized in transcript turn headers.

The condition 5 harness gains BRUNCH_BASELINE_HARD_STOP (bounded short runs), BRUNCH_BASELINE_OUTPUT_DIR (isolated evidence dirs), and tests that assert timings flush before a hard stop and that repair paths are exercised via a refuse-first-sweep stub.

The brunch-agent dev app wires @flue/opentelemetry with content: false; the walking-skeleton integration asserts expected agent/chat/tool spans and that sensitive content attributes stay off spans.

Protocol docs and turbo env passthrough are updated for the new artifacts and knobs.

^{Reviewed by Cursor Bugbot for commit 26fcca8. Bugbot is set up for automated code reviews on this repo. Configure here.}

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 35549b9. Configure here.}

Record Flue wall-clock timings in run artifacts so latency evidence no longer relies on token-volume inference. Co-authored-by: Cursor <cursoragent@cursor.com>

Co-authored-by: Cursor <cursoragent@cursor.com>

Allow short cross-check runs and persist each completed turn's timing records immediately so interrupted runs retain evidence. Co-authored-by: Cursor <cursoragent@cursor.com>

Select the applied sweep explicitly now that timing coverage exercises a refused repair path, and allow the incremental-write probe enough time under the full suite. Co-authored-by: Cursor <cursoragent@cursor.com>

The purpose-splitter unit test imports Flue observation types, so the hermetic entry-point inventory has to name it or the architecture gate fails. Co-authored-by: Cursor <cursoragent@cursor.com>

This was referenced Aug 26, 2026

FE-1506: Show captures and completion while a panel elicitation runs #9346

Open

FE-1431: Build the plugin authoring surface (cycle two) #9348

Open

FE-1507: Move the repertoire into core behind a guarded prompts subpath #9349

Open

lunelson marked this pull request as ready for review August 26, 2026 17:19

graphite-app Bot assigned lunelson Aug 26, 2026

vercel Bot deployed to Preview – petrinaut-docs August 26, 2026 17:20 View deployment

vercel Bot deployed to Preview – petrinaut August 26, 2026 17:21 View deployment

cursor Bot reviewed Aug 26, 2026

View reviewed changes

Comment thread ...shintel/brunch-agent/evaluations/protocols/process-model-elicitation/baseline/turn-timing.ts

vercel Bot deployed to Preview – hash August 26, 2026 17:34 View deployment

lunelson force-pushed the ln/fe-1505-timing branch from 0f9ff91 to 35549b9 Compare August 27, 2026 15:55

This was referenced Aug 27, 2026

Cut the agentic guidance layer to a mission charter #9381

Open

Replace the elicitation path with a plain Petrinaut-to-Flue chat. #9382

Open

vercel Bot deployed to Preview – petrinaut-docs August 27, 2026 15:58 View deployment

vercel Bot deployed to Preview – petrinaut August 27, 2026 16:00 View deployment

cursor Bot reviewed Aug 27, 2026

View reviewed changes

Comment thread apps/brunch-agent/test/baseline-harness.test.ts

vercel Bot deployed to Preview – hash August 27, 2026 16:09 View deployment

lunelson mentioned this pull request Aug 27, 2026

FE-1524: Prove idempotent capture sweep on the live Flue chat path #9384

Open

4 tasks

lunelson force-pushed the ln/fe-1506-legible-panel-status branch from ef9b8ab to aa0c7f4 Compare August 27, 2026 17:42

lunelson force-pushed the ln/fe-1505-timing branch from 35549b9 to 45ab0cd Compare August 27, 2026 17:42

vercel Bot deployed to Preview – petrinaut-docs August 27, 2026 17:45 View deployment

vercel Bot deployed to Preview – petrinaut August 27, 2026 17:46 View deployment

vercel Bot deployed to Preview – hash August 27, 2026 17:56 View deployment

lunelson and others added 10 commits August 28, 2026 14:32

Measure condition 5 turns by purpose

0f7760e

Record Flue wall-clock timings in run artifacts so latency evidence no longer relies on token-volume inference. Co-authored-by: Cursor <cursoragent@cursor.com>

Emit privacy-safe server telemetry spans

e5f1292

Co-authored-by: Cursor <cursoragent@cursor.com>

Preserve run-specific timing evidence

4455b5c

Co-authored-by: Cursor <cursoragent@cursor.com>

Fix repair timing attribution

d657382

Co-authored-by: Cursor <cursoragent@cursor.com>

Attribute compaction to harness purpose

c204016

Co-authored-by: Cursor <cursoragent@cursor.com>

Attribute compact operations to harness purpose

962d8bb

Co-authored-by: Cursor <cursoragent@cursor.com>

Attribute model continuations to harness purpose

3a779be

Co-authored-by: Cursor <cursoragent@cursor.com>

Make baseline timing runs kill-safe

2540177

Allow short cross-check runs and persist each completed turn's timing records immediately so interrupted runs retain evidence. Co-authored-by: Cursor <cursoragent@cursor.com>

Reconcile baseline timing assertions after re-braid

75ec95a

Select the applied sweep explicitly now that timing coverage exercises a refused repair path, and allow the incremental-write probe enough time under the full suite. Co-authored-by: Cursor <cursoragent@cursor.com>

Review the turn-timing test as a substrate type-import

26fcca8

The purpose-splitter unit test imports Flue observation types, so the hermetic entry-point inventory has to name it or the architecture gate fails. Co-authored-by: Cursor <cursoragent@cursor.com>

lunelson force-pushed the ln/fe-1505-timing branch from 45ab0cd to 26fcca8 Compare August 28, 2026 12:33

lunelson force-pushed the ln/fe-1506-legible-panel-status branch from aa0c7f4 to 0ba730f Compare August 28, 2026 12:33

lunelson mentioned this pull request Aug 28, 2026

Keep upcoming-mission drafts at conversational fidelity. #9405

Draft

15 tasks

vercel Bot deployed to Preview – petrinaut-docs August 28, 2026 12:35 View deployment

vercel Bot deployed to Preview – petrinaut August 28, 2026 12:36 View deployment

vercel Bot deployed to Preview – hash August 28, 2026 12:47 View deployment

kostandinang mentioned this pull request Aug 28, 2026

H-6763: Migrate voice interviews to GPT-Realtime-2 #9399

Draft

4 tasks

Navigation Menu

Uh oh!

FE-1505: Time each interviewer turn by purpose - #9347

FE-1505: Time each interviewer turn by purpose#9347
lunelson wants to merge 10 commits into
ln/fe-1506-legible-panel-statusfrom
ln/fe-1505-timing

lunelson commented Aug 26, 2026

Uh oh!

vercel Bot commented Aug 26, 2026 •

edited

Loading

Uh oh!

lunelson commented Aug 26, 2026 •

edited

Loading

Uh oh!

cursor Bot commented Aug 26, 2026 •

edited

Loading

Uh oh!

Uh oh!

cursor Bot left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

lunelson commented Aug 26, 2026

🌟 What is the purpose of this PR?

🔗 Related links

🚫 Blocked by

🔍 What does this change?

Pre-Merge Checklist 🚀

🚢 Has this modified a publishable library?

📜 Does this require a change to the docs?

Uh oh!

vercel Bot commented Aug 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lunelson commented Aug 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cursor Bot commented Aug 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Summary

Uh oh!

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

1 participant

vercel Bot commented Aug 26, 2026 •

edited

Loading

lunelson commented Aug 26, 2026 •

edited

Loading

cursor Bot commented Aug 26, 2026 •

edited

Loading