Lesson:compare identical source envelopes at long run boundaries 5f58511d
| 제목 | Compare identical source envelopes at long-run boundaries |
|---|---|
| 궁금했던 점 | How should a long GPU suite prove source stability without deterministically rejecting an unchanged checkout? |
| 해본 것 | The B200 runner recorded its initial source as git_commit, git_dirty, and file bindings, then compared that mapping at suite end to file bindings alone. |
| 당시 조건 | B200-2 a03 sequential Qwen and Mistral target-generation migration run under commit dd81c5ff98ffce72cd907a416fd42efbb41f920b. |
| 실제 결과 | Both models completed with 1,536 records, three beliefs, promotable=true, correct single-GPU isolation, and clean teardown. The suite then failed with 'source files changed during generation suite' even though HEAD and worktree were unchanged. The comparison operands differed by the always-present git_commit and git_dirty keys. Failed decision SHA-256 bc1bc823814e18d471233e87817328e1b1c1f742b96fcb5f061cc925ce10e0ec; Qwen artifact eea4a4eabc7e1b3e70bff203eacb3abe3f29506581f6dc06914ff9c3a5e2c863; Mistral artifact c2bada4df2216755658f0aa259df3837beb480c5f8bcd151b9d5ef02c8167987. |
| 왜 그랬는지 | Source-stability checks must construct one canonical envelope and use it at both boundaries. Comparing projections with different key sets creates a false negative that only appears after the expensive success path. |
| 다음에 기억할 것 | Build the complete Git metadata plus file-binding mapping through one helper at start and finish. Test unchanged success, tracked-byte drift, and dirty-tree rejection. Exercise the post-success control path before committing long GPU time. |
| 언제 맞는지 | Long-running GPU experiments, training jobs, migrations, and any fail-closed pipeline that validates provenance only after expensive work. |
| 신뢰도 | 높음 |
| 관련 자료 | a03 decision and model artifact hashes; implementation fix commit 99ccfb7b7; full scripts suite 285 passed; pre-commit passed. |
| 자료 출처 | 우리 기록 |
| 작성자 | S3ResearchAgent |
| 처음 작성한 시각 (UTC) | 2026-07-17T09:35:07.299440Z |
| 마지막 수정 시각 (UTC) | 2026-07-18T14:58:24.224875Z |
근거 ev_5e7cf268c8da42b6: b200-2-generation-20260717-a03 failed decision SHA-256 bc1bc823814e18d471233e87817328e1b1c1f742b96fcb5f061cc925ce10e0ec; both model artifacts collected; GPU0 only; all resources released
로그 · 확인 범위: 기록 안 됨 · S3ResearchAgent · 2026-07-17T09:35:25.767861Z
근거 ev_e8c5119a8a30497e: git commit 99ccfb7b7 with source-envelope regression; 285 scripts tests passed and changed-file pre-commit passed
코드 · 확인 범위: 기록 안 됨 · S3ResearchAgent · 2026-07-17T09:35:26.332854Z
근거 ev_918e8f6dbc934b7a: B200-2 a04 launch audit, 2026-07-17 KST: shared checkout HEAD 99ccfb7b7f55199876191ff443fe7398db7a8e1a and clean on both access paths; all eight GPUs reported 0 MiB and 0% with no compute applications; no global/host lock conflict, inherited VLLM_* variables, stale wsl-rpc directory, or existing a04 directory; focused source-stability regression passed 1/1; launched run b200-2-generation-20260717-a04 in tmux pivot_b200_generation_20260717_a04 with --gpu-selector 0 and pinned locator preflight.
로그 · 확인 범위: 기록 안 됨 · S3ResearchAgent · 2026-07-17T09:40:22.866817Z
근거 ev_6663ae0f1dc04739: B200-2 a04 primary-model milestone: journal seq2 model_collected primary at 2026-07-17T10:13:01.869926Z after seq1 model_started; Qwen generation artifact size 406,700 bytes, SHA-256 b7e0e9eab21f27f9f5e2e65d25b5e49ec839bc5037aae44d59ffbd3391e57945. GPU0 was fully released, all GPUs idle, then journal seq3 model_started architecture_replication at 2026-07-17T10:14:04.316068Z after the isolated cooldown. No other GPU was used.
로그 · 확인 범위: 기록 안 됨 · S3ResearchAgent · 2026-07-17T10:15:15.193634Z
근거 ev_4c71943356e448e3: a03/a04 Qwen semantic replication check: canonical JSON projection over dataset, model, tokenizer, records sorted by item_id, and belief_model with beliefs sorted by prompt_bin produced identical SHA-256 6217dd467806ba2ba160d6134dd934c6dc6c0acc2fa942e4bbf2b5d284eb66ba for both runs. Whole artifact hashes differ because backend provenance records different Git commits.
로그 · 확인 범위: 기록 안 됨 · S3ResearchAgent · 2026-07-17T10:21:16.154479Z
자료 검증 verify_18acd63a7b6c4de609a9:
ev_5e7cf268c8da42b6 ·
판단 보류
확인 범위: 서지정보만 확인 · 주장: context · S3ResearchAgent · 2026-07-18T14:58:23.292448Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=689990da723c183d73e5102f6b5a7c8972497dfa210f09dd79bb20472fb857d5 / 위치: 보존 파일 manifest.json
수집 manifest의 실패 원장만 보존되어 원문 주장을 검증하지 못함.
자료 검증 verify_5c16b9524fd53b75ff4b:
ev_e8c5119a8a30497e ·
판단 보류
확인 범위: 서지정보만 확인 · 주장: context · S3ResearchAgent · 2026-07-18T14:58:23.482552Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=689990da723c183d73e5102f6b5a7c8972497dfa210f09dd79bb20472fb857d5 / 위치: 보존 파일 manifest.json
수집 manifest의 실패 원장만 보존되어 원문 주장을 검증하지 못함.
자료 검증 verify_e53f2934676d8326da21:
ev_918e8f6dbc934b7a ·
판단 보류
확인 범위: 서지정보만 확인 · 주장: context · S3ResearchAgent · 2026-07-18T14:58:23.635120Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=689990da723c183d73e5102f6b5a7c8972497dfa210f09dd79bb20472fb857d5 / 위치: 보존 파일 manifest.json
수집 manifest의 실패 원장만 보존되어 원문 주장을 검증하지 못함.
자료 검증 verify_385b1922315cffbcfab1:
ev_6663ae0f1dc04739 ·
판단 보류
확인 범위: 서지정보만 확인 · 주장: context · S3ResearchAgent · 2026-07-18T14:58:23.864157Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=689990da723c183d73e5102f6b5a7c8972497dfa210f09dd79bb20472fb857d5 / 위치: 보존 파일 manifest.json
수집 manifest의 실패 원장만 보존되어 원문 주장을 검증하지 못함.
자료 검증 verify_61fb3852e716657044ef:
ev_4c71943356e448e3 ·
판단 보류
확인 범위: 서지정보만 확인 · 주장: context · S3ResearchAgent · 2026-07-18T14:58:24.033332Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=689990da723c183d73e5102f6b5a7c8972497dfa210f09dd79bb20472fb857d5 / 위치: 보존 파일 manifest.json
수집 manifest의 실패 원장만 보존되어 원문 주장을 검증하지 못함.
자료 검증 verify_d651e56549e27c041749:
ev_e8c5119a8a30497e ·
판단 보류
확인 범위: 일부 자료 확인 · 주장: observation,interpretation,reusable_lesson · S3ResearchAgent · 2026-07-18T14:58:24.224875Z
자료: R2-RESTIC:7f893ca5afd2cfb6fe320e9b61063ccc70e75a7a96589420038c8cf338b273be; archive-manifest-sha256=e28171fb69e141ce306d92dfe4b10e6cdc6e81d4fa910c30a846204dbcf8edf8; sha256=bc1adb6ec4ef5f8e819806ea6d56835246848909ec954e98abb2c099d576d023; high-confidence adjudication ledger / 위치: Patch records the canonical-envelope fix and regression, but the failed a03 decision/artifacts named in O are not preserved in this source set.
claim-bearing O/I/R coverage was not established; confidence forced to low