Validate publication cost provenance with a frozen offline contract - #172
Draft
MaxGhenis wants to merge 2 commits into
Draft
Validate publication cost provenance with a frozen offline contract#172MaxGhenis wants to merge 2 commits into
MaxGhenis wants to merge 2 commits into
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Retained prediction-row costs cannot establish complete billed spend or comparable synchronous estimates. This adds a frozen v1 cost-basis contract and an offline validator over the existing physical-call ledger, with separate receipts and dated normalization, exact model/call reconciliation, explicit unknowns, and synthetic fixtures.
The included frozen-release audit classifies 39 model rows across 100 scenarios and finds no call ledger in that bundle. It leaves all rows ineligible and marks missing attempts unrecoverable from the bundle. Public costs remain disabled in the new eligibility report; no public UI/export, serving treatment, reference output, launch-survivability, or stability code changes. Refs #118; this does not close it or satisfy its remaining release gates.
Validation on final head
9870b7c: all six CI checks pass, including 848 Python tests (8 skipped, 12 deselected), app, lint, and paper. The local requested ledger/cost-latency/report-cost/supervisor, Batch, and validator/audit suites pass (166 tests). Offline locked dependency sync and wheel/schema packaging pass. Both report CLIs ran with sockets denied: zero network attempts and no provider or PolicyEngine computation modules imported.Independent coordinator review is pending. Source hashes and billing attribution remain attestations for that review. No real provider pricecard or model response was fetched. Keep this PR draft; public restoration, model reruns, provenance recovery, UI gates, and release approval remain separate work.