Skip to content

docs: propose pipeline improvements — spatial standard, dtype and missing-value standard - #36

Draft
regislon wants to merge 1 commit into
mainfrom
improvement-proposals
Draft

regislon wants to merge 1 commit into
mainfrom
improvement-proposals

Conversation

@regislon

Copy link
Copy Markdown

Problem

Several changes to how the pipeline stores and lays out raster data (grid definition, tiling, chunking, data types, missing values) keep coming up in discussion, but they were not written down anywhere the team could review them together, or in the order they depend on each other.

Change

Documentation only, for discussion; no code changes.

  • docs/improvements.md: a numbered list of proposed changes in dependency order. Each entry has a description of how it works today, the motivation for changing it, and the proposed change. An entry is meant to be removed once it lands.
  • docs/improvement_spatial.md: a detailed proposal bringing together improvements 1–3, a shared spatial standard: an explicit lattice, the processing tiles, and the storage chunks and shards, so every layer admitted to an analysis grid shares the same cells.
  • docs/improvement_dtype.md: a detailed proposal for a shared standard for data types and missing values: the smallest type that holds each layer's values, and an explicit, per-layer meaning for fill values.
  • Two supporting figures (docs/figures/spatial-chunk-alignment.png, docs/image/improvement_spatial/…png).

Done when

Must have

  • The three proposal documents are in docs/ and link to each other and to architecture.md
  • The core team has reviewed the proposals and agreed which entries to take up

Nice to have

  • One issue per agreed improvement, linked from its entry in improvements.md

Testing

Impact on outputs

None.

Dependencies

None. Independent of the collaboration-setup PR.

Prepared with Claude Code (Claude Opus 5.5).

🤖 Generated with Claude Code

…ssing-value standard

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant