Skip to content

Adopt DataVault v0.4.0 with run hierarchy and log.toml discovery (v0.3.0)#5

Merged
sotashimozono merged 1 commit intomainfrom
feature/datavault-v0.4
Apr 11, 2026
Merged

Adopt DataVault v0.4.0 with run hierarchy and log.toml discovery (v0.3.0)#5
sotashimozono merged 1 commit intomainfrom
feature/datavault-v0.4

Conversation

@sotashimozono
Copy link
Copy Markdown
Owner

Summary

Adopt DataVault v0.4.0:

  • DataVault v0.3.0 added a `run` segment in the data layout (`data/{project}/{run}/...`) and a frozen `.datavault/{project}/{run}.log.toml` discovery anchor.
  • DataVault v0.4.0 added the `attach` / `open_all` programmatic query API.

Changes

  • Pin `[sources]` to `rev = "main"` so `Pkg.update` tracks upstream
  • Update `data separation: config_snapshot.toml` test for the run-segmented path (`data/{project}/{run}/config_snapshot.toml`)
  • Add a new test asserting that the log.toml discovery anchor and the `.datavault/README.md` warning are emitted on `Vault` construction
  • Bump `DynamicalModels` to v0.3.0

Test plan

  • `julia --project=. test/runtests.jl` → 451/451 pass
  • End-to-end demo: 18 Lorenz computations under `Vault(...; run="pilot")`, all marked done, ledger built
  • Vault-side `reconcile.jl` discovers `apps/DynamicalModels.jl/out/.datavault/lorenz_rho_sweep/pilot.log.toml` and aggregates 18 ledger rows into `master_ledger.csv`
  • Vault-side `search.jl --status done` returns the 18 rows with correct `app/project_name/run` columns

DataVault v0.3.0 introduced a `run` segment in the data layout
(`data/{project}/{run}/...`) and a frozen `.datavault/{project}/{run}.log.toml`
discovery anchor; v0.4.0 added the programmatic attach / open_all query
API. This commit picks up both via the github URL source.

- Pin [sources] to `rev = "main"` so Pkg.update tracks the upstream branch
- Update `data separation: config_snapshot.toml is in outdir` test for the
  new run-segmented path
- Add a new testset asserting that the log.toml discovery anchor and the
  .datavault/README.md warning are emitted on Vault construction

Bumps DynamicalModels from 0.2.0 to 0.3.0 to mark the data layout change.
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 11, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@sotashimozono sotashimozono merged commit 1e94967 into main Apr 11, 2026
10 checks passed
@sotashimozono sotashimozono deleted the feature/datavault-v0.4 branch April 11, 2026 00:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant