feat: run comparison - run metadata comparison - #2600
Merged
Conversation
This was referenced Jul 30, 2026
Collaborator
Author
🎩 PreviewA preview build has been created at: |
This was referenced Jul 30, 2026
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
July 30, 2026 23:22
bbd75eb to
6d71a83
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
2 times, most recently
from
July 31, 2026 00:24
38d1bf5 to
d0ef921
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
July 31, 2026 00:24
6d71a83 to
1b84110
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
2 times, most recently
from
July 31, 2026 01:36
dc53d9d to
1e12a5d
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
July 31, 2026 01:36
1b84110 to
378e505
Compare
4 tasks
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 14, 2026 18:17
378e505 to
a10c24a
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
2 times, most recently
from
August 14, 2026 19:07
9ef9026 to
d5b078f
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 14, 2026 19:07
a10c24a to
3508beb
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 14, 2026 21:01
d5b078f to
c24848f
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 14, 2026 21:01
3508beb to
744e5fb
Compare
3 tasks
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 14, 2026 23:47
c24848f to
e998ef1
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 14, 2026 23:47
744e5fb to
fbae585
Compare
camielvs
commented
Aug 17, 2026
camielvs
commented
Aug 17, 2026
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 17, 2026 20:01
e998ef1 to
921fd30
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 17, 2026 20:01
fbae585 to
5095ff0
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 17, 2026 23:03
5095ff0 to
df8cad2
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 17, 2026 23:03
921fd30 to
0f02d18
Compare
8 tasks
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 18, 2026 00:44
df8cad2 to
ecc36ff
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
2 times, most recently
from
August 18, 2026 00:56
6980587 to
fbe96eb
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 18, 2026 00:56
ecc36ff to
556f7e8
Compare
camielvs
marked this pull request as ready for review
August 18, 2026 01:20
Mbeaulne
approved these changes
Aug 18, 2026
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 18, 2026 21:00
fbe96eb to
dc50db3
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
2 times, most recently
from
August 18, 2026 21:59
97bfdd5 to
76a1953
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 18, 2026 21:59
dc50db3 to
32ce641
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 18, 2026 23:07
76a1953 to
d39ca43
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 18, 2026 23:07
32ce641 to
f21b148
Compare
camielvs
force-pushed
the
cmp-04-artifact-comparison
branch
from
August 19, 2026 20:50
d39ca43 to
5adb57c
Compare
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 19, 2026 20:50
f21b148 to
360348a
Compare
Collaborator
Author
camielvs
changed the base branch from
cmp-04-artifact-comparison
to
graphite-base/2600
August 19, 2026 21:12
camielvs
added a commit
that referenced
this pull request
Aug 19, 2026
## Description Fourth PR in the **Compare Runs** stack. Adds artifact comparison — the ability to see how a task's output artifacts differ between the two runs. For each output artifact it shows whether it was added, removed, changed or unchanged. Small inline values are shown directly side by side; larger artifacts show their type and size, with a **Compare** button that opens a full-screen dialog previewing both runs' versions next to each other (reusing the existing artifact preview components). Artifacts that are too large or can't be previewed are handled gracefully. Not wired into a page yet — the later task diff view consumes this. ## Related Issue and Pull requests <!-- Link to any related issues using the format #<issue-number> --> Part of the Compare Runs stack. Builds on #2598; the next PR (#2600) builds on this branch. ## Type of Change - [x] New feature ## Checklist <!-- Please ensure the following are completed before submitting the PR --> - [ ] I have tested this does not break current pipelines / runs functionality - [ ] I have tested the changes on staging ## Screenshots (if applicable) <!-- Add screenshots of the artifact diff rows and the side-by-side comparison dialog. --> ## Test Instructions Reachable once the stack is wired up (#2603). - Check out the top of the stack, enable the **Compare runs** beta flag, and compare two runs that both produced output artifacts on the same task. - Expand a task and confirm: - Artifacts show the correct Added / Removed / Changed / Unchanged status. - Small inline values are shown side by side for both runs. - Larger/previewable artifacts show a **Compare** button that opens the dialog with both runs' previews. - Non-previewable or oversized artifacts show a sensible message instead of erroring. ## Additional Comments <!-- Add any additional context or information that reviewers might need to know regarding this PR -->
camielvs
force-pushed
the
cmp-05-run-metadata-comparison
branch
from
August 19, 2026 21:17
360348a to
0e20cdb
Compare
camielvs
added a commit
that referenced
this pull request
Aug 19, 2026
## Description Sixth PR in the **Compare Runs** stack. Adds the **Structured** view — the main list-based way of reading a comparison. It shows a summary line (how many tasks were added / removed / changed / unchanged, plus how many had a different outcome) and a **Show unchanged** toggle to hide the noise. Below that, inputs, tasks and outputs are listed in sections, each row showing exactly what changed: - Per-task detail: diff status, per-run execution status (with an arrow when the outcome differs), changed arguments/annotations, cache changes, and the artifact comparison from the previous PR. - A **Compare logs** button that opens a side-by-side log diff for tasks that ran in both runs and changed. - Input/output detail rows with the same treatment. ## Related Issue and Pull requests <!-- Link to any related issues using the format #<issue-number> --> Part of the Compare Runs stack. Builds on #2600; the next PR (#2602) builds on this branch. ## Type of Change - [x] New feature ## Checklist <!-- Please ensure the following are completed before submitting the PR --> - [ ] I have tested this does not break current pipelines / runs functionality - [ ] I have tested the changes on staging ## Screenshots (if applicable) <!-- Add screenshots of the structured view: summary counts, a changed task row, and the log comparison dialog. --> ## Test Instructions Reachable once the stack is wired up (#2603). - Check out the top of the stack, enable the **Compare runs** beta flag, and compare two runs. - On the **Structured** tab, confirm: - The summary counts (added / removed / changed / unchanged / outcome differs) look right, and **Show unchanged** hides/shows unchanged rows. - Tasks, inputs and outputs are grouped into sections, with changed fields listed on each row. - A task with a different outcome is highlighted and shows both runs' statuses. - **Compare logs** opens a side-by-side log diff for a task that ran in both runs. - Two identical runs show a "no differences" state. ## Additional Comments <!-- Add any additional context or information that reviewers might need to know regarding this PR -->
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Fifth PR in the Compare Runs stack. Adds run-level metadata comparison — the context around the two runs, as opposed to their pipeline structure.
It compares who created each run, when, and any run-level annotations and arguments, and surfaces what changed. Two things are deliberately handled specially:
Annotation and argument keys are treated generically, so whatever a given deployment stores shows up without needing hardcoded knowledge of the keys. Rendered as a compact summary bar that expands to show the details when something actually differs.
Related Issue and Pull requests
Part of the Compare Runs stack. Builds on #2599; the next PR (#2601) builds on this branch.
Type of Change
Checklist
Screenshots (if applicable)
Test Instructions
npm run test -- compareRunMetadataAdditional Comments