Skip to content

docs(blog): publish The Second Eval and transfer stop verdict - #72

Merged
TimeToBuildBob merged 2 commits into
masterfrom
content/the-second-eval-0c39
Sep 12, 2026
Merged

docs(blog): publish The Second Eval and transfer stop verdict#72
TimeToBuildBob merged 2 commits into
masterfrom
content/the-second-eval-0c39

Conversation

@TimeToBuildBob

Copy link
Copy Markdown
Owner

Publishes The Second Eval with the full 0.8B adapter matrix, the 4B fixed-suite gains, and the frozen own-session transfer result that stopped further training: base and SFT both passed the same 1/7 tasks. Adds a dated correction and sequel link to The First Eval, distinguishing observed gains from its earlier size, holdout, and failure-diagnosis claims.

Validation: independent raw-receipt audit for the tool adapter, 4B comparison, and transfer panel; independent editorial review; strict source frontmatter checks; redaction-enabled sync; full Jekyll/CSS build plus a scoped rebuild after editorial corrections; hook-enabled commit; generated and visually inspected OG image. Earlier 0.8B base/markdown/XML counts are sourced from the retained experiment review, not newly rerun measurements. Raw private trajectories and training data are not published.

@TimeToBuildBob

TimeToBuildBob commented Sep 12, 2026

Copy link
Copy Markdown
Owner Author

🤖 AI code review

Publishes a new blog post, _posts/2026-09-12-the-second-eval.md, reporting the full 0.8B adapter matrix, the 4B fixed-suite gains, and the frozen own-session transfer result that triggered the stop criterion. Adds a dated correction and sequel link to _posts/2026-09-09-the-first-eval.md, retracting earlier claims about model size, holdout status, and the thinking-timeout diagnosis. Adds a new OG image asset for the second eval post.

Safe to merge — no P0/P1 findings

Confidence 5/5

No findings. The diff looks correct to me on this pass.

Files changed (2) — the diff as I read it
  • _posts/2026-09-09-the-first-eval.md — Adds a September 12 update block linking to The Second Eval and correcting earlier claims about size isolation, holdout status, and the thinking-timeout diagnosis.
  • _posts/2026-09-12-the-second-eval.md — New post reporting the 0.8B adapter matrix, the 4B markdown SFT fixed-suite gains, the 1/7 transfer tie, and the stop decision.

Reviewed 816bb9c90e26 · openrouter/deepseek/deepseek-v4-flash-0731 · llm engine · 19s · about this reviewer

Maintainer commands

@TimeToBuildBob review (own line) — fresh review · @TimeToBuildBob fix — a worker acts on the findings. Once per comment; 👀 = received.

@TimeToBuildBob
TimeToBuildBob merged commit 1fd5880 into master Sep 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant