Skip to content

test-only: Add cascade field to pipeline resource for destroy#5874

Open
andrewnester wants to merge 2 commits into
mainfrom
test/ronaldz-db/pipelines-destroy-cascade
Open

test-only: Add cascade field to pipeline resource for destroy#5874
andrewnester wants to merge 2 commits into
mainfrom
test/ronaldz-db/pipelines-destroy-cascade

Conversation

@andrewnester

Copy link
Copy Markdown
Contributor

Used for testing: #5846

ronaldz-db and others added 2 commits July 9, 2026 10:50
Add a `cascade` field to the pipeline bundle resource that controls whether
destroying a pipeline also deletes its datasets (materialized views, streaming
tables, and views). When unset, the server default applies (cascade); set
`cascade: false` to retain the datasets on destroy.

The field is delete-time only: it is not part of the pipeline spec, so it is
never sent on create/update. The direct engine persists it in state (via a
PipelineState wrapper around CreatePipeline, mirroring the sql_warehouse
lifecycle pattern) and reads it at delete time, force-sending cascade so an
explicit false survives query-string omitempty (honored for query params as of
databricks-sdk-go v0.152.0). A cascade-only change is a state-only update with
no pipeline API call. cascade is classified input_only so it does not show
remote drift.

The terraform engine drops the field for now: the pinned provider has no such
attribute yet (pending terraform-provider-databricks#5860), so terraform-engine
support is a follow-up.

Co-authored-by: Isaac
@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Approval status: pending

/acceptance/bundle/ - needs approval

Files: acceptance/bundle/refschema/out.fields.txt
Suggested: @denik
Also eligible: @pietern, @janniklasrose, @shreyas-goenka, @anton-107, @lennartkats-db

/acceptance/pipelines/ - needs approval

5 files changed
Suggested: @lennartkats-db
Also eligible: @jefferycheng1, @kanterov

/bundle/ - needs approval

5 files changed
Suggested: @denik
Also eligible: @pietern, @janniklasrose, @shreyas-goenka, @anton-107, @lennartkats-db

General files (require maintainer)

Files: NEXT_CHANGELOG.md
Based on git history:

  • @denik -- recent work in bundle/direct/dresources/, ./, bundle/schema/

Any maintainer (@anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose) can approve all areas.
See OWNERS for ownership rules.

@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: b69096c

Run: 29006267709

Env 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 4 4 230 1073 5:09
💚​ aws windows 4 4 232 1071 6:55
💚​ aws-ucws linux 4 4 314 991 6:23
💚​ aws-ucws windows 4 4 316 989 7:13
💚​ azure linux 4 4 230 1072 5:01
💚​ azure windows 4 4 232 1070 7:17
💚​ azure-ucws linux 4 4 316 988 6:27
💚​ azure-ucws windows 4 4 318 986 7:43
💚​ gcp linux 4 4 229 1074 5:37
💚​ gcp windows 4 4 231 1072 7:02
8 interesting tests: 4 RECOVERED, 4 SKIP
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
💚​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestFetchRepositoryInfoAPI_FromRepo/root 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestFetchRepositoryInfoAPI_FromRepo/subdir 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
Top 10 slowest tests (at least 2 minutes):
duration env testname
6:18 azure windows TestAccept
6:11 gcp windows TestAccept
6:07 aws-ucws windows TestAccept
6:07 azure-ucws windows TestAccept
6:02 aws windows TestAccept
2:59 aws linux TestAccept
2:57 gcp linux TestAccept
2:55 azure linux TestAccept
2:51 azure-ucws linux TestAccept
2:50 aws-ucws linux TestAccept

Comment thread NEXT_CHANGELOG.md
@lennartkats-db

Copy link
Copy Markdown
Contributor

@andrewnester I suppose this is you exercising the tests for a slightly older version of #5846?

@andrewnester

Copy link
Copy Markdown
Contributor Author

Yes, exactly, this is just to run the tests as we can't run them from forks yet

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants