Repository navigation

Record a manifest and output score statistics for every prediction run - #67

Closed

Vedaant-J wants to merge 86 commits into

vedaant/mlops-score-sketchfrom

vedaant/mlops-prediction-manifest

Closed

Record a manifest and output score statistics for every prediction run#67
Vedaant-J wants to merge 86 commits into
vedaant/mlops-score-sketchfrom
vedaant/mlops-prediction-manifest

Commits on Oct 24, 2026
- Record a snapshot manifest next to every graph index
  
  Vedaant-J
  and
  claude
  committed
  03f6992
- Address snapshot manifest review feedback
  
  Vedaant-J
  and
  claude
  committed
  a778565
- Match the backfill diff when no build commit is recorded
  
  Vedaant-J
  and
  claude
  committed
  55d1ee5
- Record each source table's full location in the snapshot manifest
  
  Vedaant-J
  and
  claude
  committed
  c8faa43
- Drop graph_id and data_version from the snapshot manifest; keep the diff private
  
  Vedaant-J
  and
  claude
  committed
  8fc3b37
- Tighten manifest schema checks and scheduler context
  
  Vedaant-J
  and
  claude
  committed
  e514912
- Drop snapshot-manifest tests of private helpers
  
  Vedaant-J
  and
  claude
  committed
  83c4756
- Trim snapshot manifest PR to essentials
  
  Vedaant-J
  and
  claude
  committed
  92801ea
- Reuse existing helpers in the snapshot manifest
  
  Vedaant-J
  and
  claude
  committed
  acb2810
- Record DiskGraph's version and build commit in manifests
  
  Vedaant-J
  and
  claude
  committed
  11ec73f
- Type source versions and allow location-free snapshot manifests
  
  Vedaant-J
  and
  claude
  committed
  3643180
- Pick the source-location lookup by connector type
  
  Vedaant-J
  and
  claude
  committed
  677d15a
- Record Custom SQL text by default; one record_sources switch
  
  Vedaant-J
  and
  claude
  committed
  e1d24f5
- Stamp the engine build commit into wheels; type directory versions
  
  Vedaant-J
  and
  claude
  committed
  3fae7ca
- Carry the record_sources choice on GraphSnapshot
  
  Vedaant-J
  and
  claude
  committed
  5656515
- Record Custom SQL's namespace and normalized fingerprint
  
  Vedaant-J
  and
  claude
  committed
  72308cf
- Make the snapshot manifest a frozen dataclass
  
  Vedaant-J
  and
  claude
  committed
  7b6ad79
- Add the MLOps switch; stub parents; drop scheduler context from manifests
  
  Vedaant-J
  and
  claude
  committed
  27996c2
- Record training-table lineage across export and reload
  
  Vedaant-J
  and
  claude
  committed
  9d3ccf7
- Digest exported parts at the source for training-table lineage
  
  Vedaant-J
  and
  claude
  committed
  5f0178f
- Record a custom table's source instead of re-reading its export
  
  Vedaant-J
  and
  claude
  committed
  f1b261a
- Record a custom table's source in the snapshot manifest's shape
  
  Vedaant-J
  and
  claude
  committed
  e25b688
- Keep sidecar writes best-effort; version custom tables from their read
  
  Vedaant-J
  and
  claude
  committed
  8de3f80
- Trim training-table lineage to essentials
  
  Vedaant-J
  and
  claude
  committed
  ea6fe84
- Read row counts and source mode from DiskGraph's manifest
  
  Vedaant-J
  and
  claude
  committed
  a494a09
- Record a custom table's source as the snapshot's manifest does
  
  Vedaant-J
  and
  claude
  committed
  fc41202
- Export a training table even when its manifest sidecar fails
  
  Vedaant-J
  and
  claude
  committed
  d9743a8
- Follow the snapshot's record_sources choice
  
  Vedaant-J
  and
  claude
  committed
  20fe503
- Expect the listing kind for a reloaded export directory
  
  Vedaant-J
  and
  claude
  committed
  d88a447
- Record a custom table's source only when the snapshot did
  
  Vedaant-J
  and
  claude
  committed
  918d0f2
- Make the training-table manifest a frozen dataclass
  
  Vedaant-J
  and
  claude
  committed
  27fc36d
- Give training tables a deterministic id, embedded snapshot, root store
  
  Vedaant-J
  and
  claude
  committed
  7858ace
- Export TrainingTableManifest
  
  Vedaant-J
  and
  claude
  committed
  732f4c3
- Record bundle_id and fit provenance in every model bundle
  
  Vedaant-J
  and
  claude
  committed
  cca0d00
- Address bundle provenance review feedback
  
  Vedaant-J
  and
  claude
  committed
  1b67699
- Read Trainer.bundle_id defensively
  
  Vedaant-J
  and
  claude
  committed
  d15d97e
- Record the published model's fit mode in provenance.json
  
  Vedaant-J
  and
  claude
  committed
  ffbf206
- Mirror the training table's source in bundle provenance
  
  Vedaant-J
  and
  claude
  committed
  2a6fea3
- Trim provenance.json to facts no other bundle file holds
  
  Vedaant-J
  and
  claude
  committed
  68e72b9
- Record fit_mode and source versions in provenance; expose it on Trainer
  
  Vedaant-J
  and
  claude
  committed
  c5fe930
- Trim bundle provenance to essentials
  
  Vedaant-J
  and
  claude
  committed
  d3de46a
- Reuse shared helpers for bundle provenance
  
  Vedaant-J
  and
  claude
  committed
  efaeced
- Compute a fresh bundle's id from its publication manifest
  
  Vedaant-J
  and
  claude
  committed
  c728893
- Copy a custom table's full source entry into provenance
  
  Vedaant-J
  and
  claude
  committed
  58b80d3
- Store the bundle id in provenance.json
  
  Vedaant-J
  and
  claude
  committed
  f70ee4d
- Make bundle provenance a frozen dataclass
  
  Vedaant-J
  and
  claude
  committed
  4217144
- Embed the training table in a self-contained model manifest; store models
  
  Vedaant-J
  and
  claude
  committed
  1320948
- Store the model under the root after the plain export
  
  Vedaant-J
  and
  claude
  committed
  456b97d
- Add GraphSnapshot export and load through object storage
  
  Vedaant-J
  and
  claude
  committed
  231a309
- Ship the object-store sink in the public connector image
  
  Vedaant-J
  and
  claude
  committed
  3fd23a1
- Report source changes since a snapshot and warn on stale loads
  
  Vedaant-J
  and
  claude
  committed
  faabba5
- Match source changes on the recorded connector and location
  
  Vedaant-J
  and
  claude
  committed
  e315517
- Keep an existing export when a rebuilt snapshot is re-exported
  
  Vedaant-J
  and
  claude
  committed
  2c75c50
- Pass allow_delayed_open to S3 only when pyarrow supports it
  
  Vedaant-J
  and
  claude
  committed
  2b40f15
- Trim comments and implementation-detail tests
  
  Vedaant-J
  and
  claude
  committed
  fa780f0
- Trim snapshot export PR to essentials
  
  Vedaant-J
  and
  claude
  committed
  6cf5f82
- Move snapshot export checksums into DiskGraph and reuse its manifest
  
  Vedaant-J
  and
  claude
  committed
  5f8239a
- Check loaded snapshots with what DiskGraph already stamps
  
  Vedaant-J
  and
  claude
  committed
  66fb6d2
- Derive GraphSnapshot.graph_key from the snapshot id
  
  Vedaant-J
  and
  claude
  committed
  6bc6d6c
- Make snapshot export atomic and pass the snapshot manifest through
  
  Vedaant-J
  and
  claude
  committed
  51f5e8c
- Drop the S3 upload tuning from snapshot export
  
  Vedaant-J
  and
  claude
  committed
  e910bc2
- Repair files a concurrent export wiped before committing
  
  Vedaant-J
  and
  claude
  committed
  b1924ef
- Compare directory listings in source_changes
  
  Vedaant-J
  and
  claude
  committed
  6839eea
- Drop the connector-image allowlist entry for the removed sink test
  
  Vedaant-J
  and
  claude
  committed
  1e2b14c
- Raise ConcurrentExportError when another export keeps replacing the destination
  
  Vedaant-J
  and
  claude
  committed
  cc48acd
- Read snapshot manifests as dataclasses in export and source_changes
  
  Vedaant-J
  and
  claude
  committed
  318c18b
- Export snapshots through a config to any file store; store in MLOps scope
  
  Vedaant-J
  and
  claude
  committed
  46465ff
- Add PredictiveQuery.from_snapshot for graph-free scoring
  
  Vedaant-J
  and
  claude
  committed
  68152b0
- Expose Trainer.training_query and keep the graph-bound snapshot check
  
  Vedaant-J
  and
  claude
  committed
  5256d2c
- Trim comments and implementation-detail tests
  
  Vedaant-J
  and
  claude
  committed
  81fb21c
- Read the native graph and graph id from GraphSnapshot
  
  Vedaant-J
  and
  claude
  committed
  4ffea50
- Add Trainer.predict_snapshot for one-call graph-free scoring
  
  Vedaant-J
  and
  claude
  committed
  76da3dc
- Test graph-free scoring of an exported snapshot end to end
  
  Vedaant-J
  and
  claude
  committed
  aab9d02
- Warn when predict_snapshot scores another graph's snapshot
  
  Vedaant-J
  and
  claude
  committed
  32e9cdd
- One predict path: predict(snapshot, ...); results predict too
  
  Vedaant-J
  and
  claude
  committed
  c5b4bc8
- Hide the torch-scatter hint across all of predict()
  
  Vedaant-J
  and
  claude
  committed
  4fd38b9
- Compare reloaded-model scores within float tolerance
  
  Vedaant-J
  and
  claude
  committed
  803cd82
- Report fit progress events to callbacks
  
  Vedaant-J
  and
  claude
  committed
  7cdc1ef
- Record Trainer.fit in MLflow through MLOps tracking
  
  Vedaant-J
  and
  claude
  committed
  d97b285
- Record Trainer.fit in Snowflake Experiment Tracking
  
  Vedaant-J
  and
  claude
  committed
  ef5ed4b
- Carry scoring defaults in a derived model bundle
  
  Vedaant-J
  and
  claude
  committed
  206d88b
- Add model aliases and registry registration through MLOps
  
  Vedaant-J
  and
  claude
  committed
  c0a5e72
- Log, register and serve fitted models through MLflow pyfunc
  
  Vedaant-J
  and
  claude
  committed
  a8aad9a
- Add Databricks, SageMaker and Snowflake job templates for kumo-engine
  
  Vedaant-J
  and
  claude
  committed
  1ea72bb
- Record holdout score statistics in the model manifest, via DiskGraph
  
  Vedaant-J
  and
  claude
  committed
  d5b3c35
- Record a manifest for every prediction run
  
  Vedaant-J
  and
  claude
  committed
  ef2cb21

Commits

Commits on Oct 24, 2026