databricks-cli/bundle
Andrew Nester 48ff18e5fc
Upload local libraries even if they don't have artifact defined (#1664)
## Changes
Previously for all the libraries referenced in configuration DABs made
sure that there is corresponding artifact section.
But this is not really necessary and flexible, because local libraries
might be built outside of dabs context.
It also created difficult to follow logic in code where we back
referenced libraries to artifacts which was difficult to fllow


This PR does 3 things:
1. Allows all local libraries referenced in DABs config to be uploaded
to remote
2. Simplifies upload and glob references expand logic by doing this in
single place
3. Speed things up by uploading library only once and doing this in
parallel

## Tests
Added unit + integration tests + made sure that change is backward
compatible (no changes in existing tests)

---------

Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
2024-08-14 09:03:44 +00:00
..
artifacts Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
config Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
deploy Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
env Remove support for DATABRICKS_BUNDLE_INCLUDES (#1317) 2024-03-27 10:13:54 +00:00
internal Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
libraries Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
metadata Make `file_path` and `artifact_path` fields consistent with json tag (#987) 2023-11-15 13:37:26 +00:00
permissions Properly deal with nil values in `convert.FromTyped` (#1511) 2024-06-21 13:43:21 +00:00
phases Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
python Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
render Support multiple paths for diagnostics (#1616) 2024-07-25 15:16:27 +00:00
run Processing and completion of positional args to bundle run (#1120) 2024-04-22 11:50:13 +00:00
schema Added support for complex variables (#1467) 2024-06-26 10:25:32 +00:00
scripts Print diagnostics in 'bundle deploy' (#1579) 2024-07-10 11:14:57 +00:00
tests Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
bundle.go Use `vfs.Path` for filesystem interaction (#1554) 2024-07-03 10:13:22 +00:00
bundle_read_only.go Use `vfs.Path` for filesystem interaction (#1554) 2024-07-03 10:13:22 +00:00
bundle_test.go Update error checks that use the `os` package to use `errors.Is` (#1461) 2024-06-03 12:39:36 +00:00
context.go Rename variable `bundle -> b` (#989) 2023-11-15 14:03:36 +00:00
context_test.go Add command that writes the materialized bundle configuration to stdout (#95) 2022-11-21 15:39:53 +01:00
deferred.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
deferred_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
if.go Return early in bundle destroy if no deployment exists (#1581) 2024-07-09 15:08:38 +00:00
if_test.go Return early in bundle destroy if no deployment exists (#1581) 2024-07-09 15:08:38 +00:00
log_string.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
mutator.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
mutator_read_only.go Added validate mutator to surface additional bundle warnings (#1352) 2024-04-18 15:13:16 +00:00
mutator_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
parallel.go Added validate mutator to surface additional bundle warnings (#1352) 2024-04-18 15:13:16 +00:00
parallel_test.go Fix flaky tests for the parallel mutator (#1426) 2024-05-13 12:16:43 +00:00
root.go Move folders package into libs (#1184) 2024-02-07 16:33:18 +00:00
root_test.go Remove support for DATABRICKS_BUNDLE_INCLUDES (#1317) 2024-03-27 10:13:54 +00:00
seq.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
seq_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00