Skip to content

Avoid .NET globalization crash in LLM benchmarks#5335

Merged
bradleyshep merged 9 commits into
bradley/fix-validate-goldens-cifrom
bot/debug-llm-csharp-publish
Jun 16, 2026
Merged

Avoid .NET globalization crash in LLM benchmarks#5335
bradleyshep merged 9 commits into
bradley/fix-validate-goldens-cifrom
bot/debug-llm-csharp-publish

Conversation

@clockwork-labs-bot

@clockwork-labs-bot clockwork-labs-bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

Description of Changes

Sets DOTNET_SYSTEM_GLOBALIZATION_INVARIANT=1 only on the benchmark harness command that publishes generated C# modules. This keeps dotnet startup out of localized DateTime/TimeZoneInfo formatting on the CI runner, which was crashing before generated C# module publish could run.

Stacked on #5324.

gh workflow run llm-benchmark-periodic.yml \
  --repo ClockworkLabs/SpacetimeDB \
  --ref bot/debug-llm-csharp-publish \
  -f model_set=explicit \
  -f models="openrouter:openai/gpt-5.4-mini" \
  -f languages=rust,csharp,typescript \
  -f modes=guidelines \
  -f tasks=t_000_empty_reducers \
  -f dry_run=true

API and ABI breaking changes

None.

Expected complexity level and risk

  1. CI benchmark harness environment fix.

Testing

  • cargo fmt --all
  • cargo check --manifest-path tools/xtask-llm-benchmark/Cargo.toml
  • ruby -e 'require "yaml"; YAML.load_file(".github/workflows/llm-benchmark-periodic.yml"); YAML.load_file(".github/workflows/llm-benchmark-validate-goldens.yml")'\n- [x] git diff --check

@bfops bfops marked this pull request as draft June 15, 2026 23:29
@clockwork-labs-bot clockwork-labs-bot changed the title Add LLM benchmark publish diagnostics Avoid .NET globalization crash in LLM benchmarks Jun 16, 2026
@bfops bfops requested review from bradleyshep and removed request for bfops, cloutiertyler and jdetter June 16, 2026 02:54
@bfops bfops marked this pull request as ready for review June 16, 2026 02:54
@bradleyshep bradleyshep merged commit 23ab3f7 into bradley/fix-validate-goldens-ci Jun 16, 2026
29 of 30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants