steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
databricks-cli/bundle/config/mutator
History
Andrew Nester 1b0ac61093
Added deployment state for bundles (#1267) 
## Changes
This PR introduces new structure (and a file) being used locally and
synced remotely to Databricks workspace to track bundle deployment
related metadata.

The state is pulled from remote, updated and pushed back remotely as
part of `bundle deploy` command.

This state can be used for deployment sequencing as it's `Version` field
is monotonically increasing on each deployment.

Currently, it only tracks files being synced as part of the deployment.

This helps fix the issue with files not being removed during deployments
on CI/CD as sync snapshot was never present there.

Fixes #943 

## Tests
Added E2E (regression) test for files removal on CI/CD

---------

Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
 		2024-03-18 14:41:58 +00:00
..
default_target.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
default_target_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
default_workspace_paths.go Make `file_path` and `artifact_path` fields consistent with json tag (#987) 2023-11-15 13:37:26 +00:00
default_workspace_paths_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
default_workspace_root.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
default_workspace_root_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
environments_compat.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
environments_compat_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
expand_pipeline_glob_paths.go Retain location annotation when expanding globs for pipeline libraries (#1274) 2024-03-11 21:59:36 +00:00
expand_pipeline_glob_paths_test.go Retain location annotation when expanding globs for pipeline libraries (#1274) 2024-03-11 21:59:36 +00:00
expand_workspace_root.go Added support for bundle.Seq, simplified Mutator.Apply interface (#403) 2023-05-24 14:45:19 +02:00
expand_workspace_root_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
if.go Make a notebook wrapper for Python wheel tasks optional (#797) 2023-09-26 14:32:20 +00:00
initialize_variables.go Initialize variable definitions that are defined without properties (#966) 2023-11-08 11:01:14 +00:00
initialize_variables_test.go Initialize variable definitions that are defined without properties (#966) 2023-11-08 11:01:14 +00:00
initialize_workspace_client.go Fix panic when bundle auth resolution fails (#1002) 2023-11-30 14:28:01 +00:00
load_git_details.go Persist deployment metadata in WSFS (#845) 2023-10-27 12:55:43 +00:00
merge_job_clusters.go Include `dyn.Path` as argument to the visit callback function (#1260) 2024-03-07 13:56:50 +00:00
merge_job_clusters_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
merge_job_tasks.go Include `dyn.Path` as argument to the visit callback function (#1260) 2024-03-07 13:56:50 +00:00
merge_job_tasks_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
merge_pipeline_clusters.go Include `dyn.Path` as argument to the visit callback function (#1260) 2024-03-07 13:56:50 +00:00
merge_pipeline_clusters_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
mutator.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
noop.go Make a notebook wrapper for Python wheel tasks optional (#797) 2023-09-26 14:32:20 +00:00
override_compute.go Consolidate environment variable interaction (#747) 2023-09-11 08:18:43 +00:00
override_compute_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
populate_current_user.go Add short_name helper function to bundle init templates (#1167) 2024-02-01 16:46:07 +00:00
populate_current_user_test.go Add short_name helper function to bundle init templates (#1167) 2024-02-01 16:46:07 +00:00
process_include.go Added support for bundle.Seq, simplified Mutator.Apply interface (#403) 2023-05-24 14:45:19 +02:00
process_include_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
process_root_includes.go Consolidate environment variable interaction (#747) 2023-09-11 08:18:43 +00:00
process_root_includes_test.go Added deployment state for bundles (#1267) 2024-03-18 14:41:58 +00:00
process_target_mode.go Add correct tag value for models in dev mode (#1230) 2024-02-22 14:52:49 +00:00
process_target_mode_test.go Add correct tag value for models in dev mode (#1230) 2024-02-22 14:52:49 +00:00
resolve_resource_references.go Allow referencing bundle resources by name (#872) 2024-01-04 21:04:42 +00:00
resolve_resource_references_test.go Return `application_id` for service principal lookups (#1245) 2024-03-04 16:12:10 +00:00
resolve_variable_references.go Allow use of variables references in primitive non-string fields (#1219) 2024-02-19 10:44:51 +00:00
resolve_variable_references_test.go Allow use of variables references in primitive non-string fields (#1219) 2024-02-19 10:44:51 +00:00
rewrite_sync_paths.go Include `dyn.Path` as argument to the visit callback function (#1260) 2024-03-07 13:56:50 +00:00
rewrite_sync_paths_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
run_as.go Added run_as section for bundle configuration (#692) 2023-08-23 16:47:07 +00:00
select_default_target.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
select_default_target_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
select_target.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
select_target_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
set_variables.go Allow referencing bundle resources by name (#872) 2024-01-04 21:04:42 +00:00
set_variables_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00
trampoline.go Make `file_path` and `artifact_path` fields consistent with json tag (#987) 2023-11-15 13:37:26 +00:00
trampoline_test.go Consolidate environment variable interaction (#747) 2023-09-11 08:18:43 +00:00
translate_paths.go Make `file_path` and `artifact_path` fields consistent with json tag (#987) 2023-11-15 13:37:26 +00:00
translate_paths_artifacts.go Make resource and artifact paths in bundle config relative to config folder (#708) 2023-09-04 09:55:01 +00:00
translate_paths_jobs.go Enable `spark_jar_task` with local JAR libraries (#993) 2023-11-21 10:15:09 +00:00
translate_paths_pipelines.go Make resource and artifact paths in bundle config relative to config folder (#708) 2023-09-04 09:55:01 +00:00
translate_paths_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
validate_git_details.go Add validation for Git settings in bundles (#578) 2023-07-30 12:44:33 +00:00
validate_git_details_test.go Replace direct calls with `bundle.Apply` (#990) 2023-11-15 14:19:18 +00:00