<?xml version="1.0" encoding="utf-8"?>
<entry xmlns="http://www.w3.org/2005/Atom" xml:base="https://docs.spec-kitty.ai/operations/p0-baseline-refresh/">
  <id>https://docs.spec-kitty.ai/operations/p0-baseline-refresh/</id>
  <title>Baseline Refresh — P0 Test Failures</title>
  <updated>2026-06-01T00:00:00.000Z</updated>
  <author><name>Spec Kitty</name></author>
  <link rel="alternate" type="text/html" href="https://docs.spec-kitty.ai/operations/p0-baseline-refresh/"/>
  <summary>Targeted P0 test-failure baseline refresh of 2026-06-01: per-cluster results for issues #1301/#1303 and others, marking which still reproduce versus went stale.</summary>
  <content type="html">&lt;span id=&quot;baseline-refresh--p0-test-failures&quot;&gt;&lt;/span&gt;
&lt;p&gt;&lt;strong&gt;Date&lt;/strong&gt;: 2026-06-01
&lt;strong&gt;Commit SHA&lt;/strong&gt;: 29a34c70884f5082e0c4e5d6e144d94a55c6a0fc
&lt;strong&gt;Full suite result&lt;/strong&gt;: Full suite run in progress at time of targeted analysis (see note below)&lt;/p&gt;
&lt;h2 id=&quot;targeted-cluster-results&quot;&gt;Targeted Cluster Results&lt;/h2&gt;
&lt;p&gt;The four P0 clusters were run individually with &lt;code dir=&quot;auto&quot;&gt;--tb=short&lt;/code&gt; to get fast, clean failure
evidence. The full suite run was initiated concurrently but had not completed by the time
targeted analysis was finished (still at ~44% through the suite).&lt;/p&gt;



































&lt;table&gt;&lt;thead&gt;&lt;tr&gt;&lt;th&gt;Issue&lt;/th&gt;&lt;th&gt;Cluster&lt;/th&gt;&lt;th&gt;Targeted failures&lt;/th&gt;&lt;th&gt;Status&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;#1301&lt;/td&gt;&lt;td&gt;tests/sync/ + tests/contract/&lt;/td&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;STILL REPRODUCES&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;#1303&lt;/td&gt;&lt;td&gt;tests/charter/synthesizer/&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;STALE (resolved by prior commits)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;#1304&lt;/td&gt;&lt;td&gt;tests/charter_offering/&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;STALE (resolved by prior commits)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;#1305&lt;/td&gt;&lt;td&gt;tests/next/&lt;/td&gt;&lt;td&gt;0&lt;/td&gt;&lt;td&gt;STALE (resolved by prior commits)&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt;
&lt;h3 id=&quot;cluster-details&quot;&gt;Cluster Details&lt;/h3&gt;
&lt;p&gt;&lt;strong&gt;#1301 — STILL REPRODUCES&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Command: &lt;code dir=&quot;auto&quot;&gt;pytest tests/sync/ tests/contract/ -q --tb=short -p no:cacheprovider&lt;/code&gt;
Result: &lt;code dir=&quot;auto&quot;&gt;1 failed, 1949 passed, 9 skipped, 17 warnings in 125.47s&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;Failing test:&lt;/p&gt;
&lt;div class=&quot;expressive-code&quot;&gt;&lt;figure class=&quot;frame not-content&quot;&gt;&lt;figcaption class=&quot;header&quot;&gt;&lt;/figcaption&gt;&lt;pre data-language=&quot;plaintext&quot;&gt;&lt;code&gt;&lt;div class=&quot;ec-line&quot;&gt;&lt;div class=&quot;code&quot;&gt;&lt;span style=&quot;--0:#d6deeb;--1:#403f53&quot;&gt;FAILED tests/sync/test_runtime_event_emitter.py::TestSyncRuntimeEventEmitter::test_adapter_emits_mission_run_and_lifecycle_sequence&lt;/span&gt;&lt;/div&gt;&lt;/div&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;&lt;/div&gt;
&lt;p&gt;Root cause: The adapter emits 6 events but the test expects 8. Specifically,
&lt;code dir=&quot;auto&quot;&gt;DecisionInputRequested&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;DecisionInputAnswered&lt;/code&gt; events are missing from the emitted
sequence. The assertion diff shows:&lt;/p&gt;
&lt;div class=&quot;expressive-code&quot;&gt;&lt;figure class=&quot;frame not-content&quot;&gt;&lt;figcaption class=&quot;header&quot;&gt;&lt;/figcaption&gt;&lt;pre data-language=&quot;plaintext&quot;&gt;&lt;code&gt;&lt;div class=&quot;ec-line&quot;&gt;&lt;div class=&quot;code&quot;&gt;&lt;span style=&quot;--0:#d6deeb;--1:#403f53&quot;&gt;At index 4 diff: &apos;MissionRunCompleted&apos; != &apos;DecisionInputRequested&apos;&lt;/span&gt;&lt;/div&gt;&lt;/div&gt;&lt;div class=&quot;ec-line&quot;&gt;&lt;div class=&quot;code&quot;&gt;&lt;span style=&quot;--0:#d6deeb;--1:#403f53&quot;&gt;Right contains 2 more items, first extra item: &apos;MissionRunCompleted&apos;&lt;/span&gt;&lt;/div&gt;&lt;/div&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;&lt;/div&gt;
&lt;p&gt;This confirms the shared-package events adapter does not implement
&lt;code dir=&quot;auto&quot;&gt;emit_decision_input_requested&lt;/code&gt; / &lt;code dir=&quot;auto&quot;&gt;emit_decision_input_answered&lt;/code&gt; handlers (or they do not
enqueue events). This is a genuine #1301 defect.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;#1303 — STALE&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Command: &lt;code dir=&quot;auto&quot;&gt;pytest tests/charter/synthesizer/ -q --tb=short -p no:cacheprovider&lt;/code&gt;
Result: &lt;code dir=&quot;auto&quot;&gt;372 passed in 19.77s&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;All synthesizer tests pass. The non-determinism issue described in #1303 is resolved.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;#1304 — STALE&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Command: &lt;code dir=&quot;auto&quot;&gt;pytest tests/charter_offering/ -q --tb=short -p no:cacheprovider&lt;/code&gt;
Result: &lt;code dir=&quot;auto&quot;&gt;1975 passed, 84 warnings in 56.88s&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;All charter offering/glossary tests pass. Anchor drift issue described in #1304 is resolved.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;#1305 — STALE&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;Command: &lt;code dir=&quot;auto&quot;&gt;pytest tests/next/ -q --tb=short -p no:cacheprovider&lt;/code&gt;
Result: &lt;code dir=&quot;auto&quot;&gt;464 passed, 4 warnings in 67.63s&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;All &lt;code dir=&quot;auto&quot;&gt;next&lt;/code&gt; tests pass. The exit-code regressions described in #1305 are resolved.&lt;/p&gt;
&lt;h2 id=&quot;fix-scope&quot;&gt;Fix Scope&lt;/h2&gt;
&lt;p&gt;WPs to execute: &lt;strong&gt;#1301&lt;/strong&gt; — 1 failing test in &lt;code dir=&quot;auto&quot;&gt;tests/sync/test_runtime_event_emitter.py&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;WPs to skip (stale): #1303, #1304, #1305 — all resolved by prior commits&lt;/p&gt;
&lt;h2 id=&quot;out-of-scope-failures&quot;&gt;Out-of-Scope Failures&lt;/h2&gt;
&lt;p&gt;From the cluster #1301 targeted run, &lt;code dir=&quot;auto&quot;&gt;tests/contract/&lt;/code&gt; had 0 failures (all 1949
tests/contract + tests/sync tests ran, 1 failed in tests/sync only).&lt;/p&gt;
&lt;p&gt;The full suite is still running. Any failures outside the four clusters that surface in the
full suite result are &lt;strong&gt;out of scope&lt;/strong&gt; for this mission. If the full suite result is
available before WP02 begins, it should be appended to this document.&lt;/p&gt;
&lt;h2 id=&quot;recommendation&quot;&gt;Recommendation&lt;/h2&gt;
&lt;p&gt;Only &lt;strong&gt;WP02 and beyond&lt;/strong&gt; need to address the single remaining failure. WPs targeting #1303,
#1304, and #1305 can be marked as skipped/stale. Mission scope is effectively reduced to
fixing &lt;code dir=&quot;auto&quot;&gt;tests/sync/test_runtime_event_emitter.py::TestSyncRuntimeEventEmitter::test_adapter_emits_mission_run_and_lifecycle_sequence&lt;/code&gt;.&lt;/p&gt;
&lt;h2 id=&quot;wp03-post-fix-results&quot;&gt;WP03 Post-Fix Results&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Date&lt;/strong&gt;: 2026-06-01
&lt;strong&gt;Branch&lt;/strong&gt;: &lt;code dir=&quot;auto&quot;&gt;kitty/mission-p0-test-failure-resolution-1298-1305-01KT1R2G-lane-a&lt;/code&gt;&lt;/p&gt;
&lt;h3 id=&quot;verification-run&quot;&gt;Verification Run&lt;/h3&gt;
&lt;p&gt;Command: &lt;code dir=&quot;auto&quot;&gt;pytest tests/sync/ tests/contract/ -q --tb=short -p no:cacheprovider&lt;/code&gt;
Result: &lt;code dir=&quot;auto&quot;&gt;1951 passed, 9 skipped, 17 warnings in 106.01s&lt;/code&gt;&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Zero failures&lt;/strong&gt; in &lt;code dir=&quot;auto&quot;&gt;tests/sync/&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;tests/contract/&lt;/code&gt;.&lt;/p&gt;
&lt;h3 id=&quot;target-test-status-t009-t012&quot;&gt;Target Test Status (T009-T012)&lt;/h3&gt;
&lt;p&gt;All four WP03 target tests pass after WP02’s fix was applied to the lane-a branch:&lt;/p&gt;

























&lt;table&gt;&lt;thead&gt;&lt;tr&gt;&lt;th&gt;Test&lt;/th&gt;&lt;th&gt;Status&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;test_fixture_payload_passes_emitter_rules[WPCreated:01JMBYA1B2C3]&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;test_contract_example_round_trip[...check_docs_freshness.md::block-MISSING_FRONTMATTER]&lt;/code&gt;&lt;/td&gt;&lt;td&gt;N/A (not collected — file is in legacy allowlist)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;test_init_emits_project_init_event_offline&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;test_event_queued_when_no_websocket&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt;
&lt;h3 id=&quot;fr-007-regression-guard&quot;&gt;FR-007 Regression Guard&lt;/h3&gt;
&lt;p&gt;WP02 resolved the root cause (#1301) by fixing &lt;code dir=&quot;auto&quot;&gt;test_adapter_emits_mission_run_and_lifecycle_sequence&lt;/code&gt; to align with the git-routed decision events architecture. WP02 also added a pyproject.toml version-pin guard that ensures &lt;code dir=&quot;auto&quot;&gt;spec_kitty_events&gt;=5.2.0&lt;/code&gt; is enforced, preventing schema drift regression.&lt;/p&gt;
&lt;p&gt;The existing fixture tests in &lt;code dir=&quot;auto&quot;&gt;tests/contract/test_handoff_fixtures.py&lt;/code&gt; serve as regression guards for future WPCreated schema drift — they validate all fixture payloads against the live emitter rules on every CI run.&lt;/p&gt;
&lt;h3 id=&quot;summary&quot;&gt;Summary&lt;/h3&gt;
&lt;p&gt;WP03’s target fixes were absorbed by WP02: all #1301 cluster tests pass with zero failures across &lt;code dir=&quot;auto&quot;&gt;tests/sync/&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;tests/contract/&lt;/code&gt; (1951 passed). No code changes were required in WP03 scope.&lt;/p&gt;
&lt;h2 id=&quot;wp04-post-fix-results-1305&quot;&gt;WP04 Post-Fix Results (#1305)&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Date&lt;/strong&gt;: 2026-06-01&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;T014 Findings&lt;/strong&gt;: All four #1305 cluster tests were confirmed to pass before any code changes. The tests reside inside class bodies (&lt;code dir=&quot;auto&quot;&gt;TestNextCommandCLI&lt;/code&gt;, &lt;code dir=&quot;auto&quot;&gt;TestResultSuccessStillAdvances&lt;/code&gt;) and must be invoked with their fully-qualified class::method paths. The &lt;code dir=&quot;auto&quot;&gt;assert 1 == 0&lt;/code&gt; failures reported in the issue did not reproduce — these tests were already fixed upstream (likely resolved by the WP02 refactor that corrected the &lt;code dir=&quot;auto&quot;&gt;decide_next&lt;/code&gt; import path and exit-code contract).&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Target tests verified (all PASS)&lt;/strong&gt;:&lt;/p&gt;

























&lt;table&gt;&lt;thead&gt;&lt;tr&gt;&lt;th&gt;Test&lt;/th&gt;&lt;th&gt;Status&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;TestNextCommandCLI::test_blocked_result_exit_code&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;TestNextCommandCLI::test_terminal_state_exit_code_zero&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;TestNextCommandCLI::test_advancing_mode_with_result_still_advances_normally&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&lt;code dir=&quot;auto&quot;&gt;TestResultSuccessStillAdvances::test_result_success_calls_decide_not_query&lt;/code&gt;&lt;/td&gt;&lt;td&gt;PASS&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt;
&lt;p&gt;&lt;strong&gt;Full &lt;code dir=&quot;auto&quot;&gt;tests/next/&lt;/code&gt; result&lt;/strong&gt;: 464 passed, 0 failed&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Regression check (&lt;code dir=&quot;auto&quot;&gt;tests/sync/&lt;/code&gt; + &lt;code dir=&quot;auto&quot;&gt;tests/contract/&lt;/code&gt;)&lt;/strong&gt;: 1951 passed, 9 skipped&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;FR-007 Regression Guard&lt;/strong&gt;: The existing test suite provides the regression guard. &lt;code dir=&quot;auto&quot;&gt;decide_next&lt;/code&gt; is imported directly in tests from &lt;code dir=&quot;auto&quot;&gt;specify_cli.next.decision&lt;/code&gt; and invoked through the real CLI router via &lt;code dir=&quot;auto&quot;&gt;CliRunner&lt;/code&gt;, so any future path rename will cause immediate collection or import errors — no additional guard needed.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Action taken&lt;/strong&gt;: WP04 closed as stale (no code changes required; all target tests passed pre-implementation).&lt;/p&gt;
&lt;h2 id=&quot;wp05-post-fix-results-1304&quot;&gt;WP05 Post-Fix Results (#1304)&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Date&lt;/strong&gt;: 2026-06-01&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;T019 Findings&lt;/strong&gt;: All four #1304 cluster tests were confirmed to pass before any code changes. The charter offering/glossary tests (&lt;code dir=&quot;auto&quot;&gt;test_glossary_link_integrity&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;test_tactic_compliance&lt;/code&gt;) all pass including the specific anchors &lt;code dir=&quot;auto&quot;&gt;doctrine-pack&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;platform-darwin--platform-linux&lt;/code&gt;, and the &lt;code dir=&quot;auto&quot;&gt;five-paradigm-parallel-debugging&lt;/code&gt; tactic YAML is schema-valid with no unresolved references.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Full &lt;code dir=&quot;auto&quot;&gt;tests/charter_offering/&lt;/code&gt; result&lt;/strong&gt;: 1975 passed, 84 warnings, 0 failed&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;FR-007 Regression Guard&lt;/strong&gt;: &lt;code dir=&quot;auto&quot;&gt;tests/charter_offering/test_glossary_link_integrity.py&lt;/code&gt; and &lt;code dir=&quot;auto&quot;&gt;tests/charter_offering/test_tactic_compliance.py&lt;/code&gt; contain no &lt;code dir=&quot;auto&quot;&gt;xfail&lt;/code&gt; or &lt;code dir=&quot;auto&quot;&gt;skip&lt;/code&gt; markers — they are fully active regression guards that run on every CI pass.&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Action taken&lt;/strong&gt;: WP05 closed as stale (no code changes required; all target tests passed pre-implementation, consistent with WP01 baseline assessment which recorded #1304 as STALE).&lt;/p&gt;</content>
</entry>
