databricks-cli/bundle/libraries
Andrew Nester 48ff18e5fc
Upload local libraries even if they don't have artifact defined (#1664)
## Changes
Previously for all the libraries referenced in configuration DABs made
sure that there is corresponding artifact section.
But this is not really necessary and flexible, because local libraries
might be built outside of dabs context.
It also created difficult to follow logic in code where we back
referenced libraries to artifacts which was difficult to fllow


This PR does 3 things:
1. Allows all local libraries referenced in DABs config to be uploaded
to remote
2. Simplifies upload and glob references expand logic by doing this in
single place
3. Speed things up by uploading library only once and doing this in
parallel

## Tests
Added unit + integration tests + made sure that change is backward
compatible (no changes in existing tests)

---------

Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
2024-08-14 09:03:44 +00:00
..
testdata Refactor library to artifact matching to not use pointers (#1172) 2024-02-05 15:29:45 +00:00
expand_glob_references.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
expand_glob_references_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
helpers.go Refactor library to artifact matching to not use pointers (#1172) 2024-02-05 15:29:45 +00:00
helpers_test.go Refactor library to artifact matching to not use pointers (#1172) 2024-02-05 15:29:45 +00:00
libraries.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
local_path.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
local_path_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
match_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
upload.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
upload_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
workspace_path.go Refactor library to artifact matching to not use pointers (#1172) 2024-02-05 15:29:45 +00:00
workspace_path_test.go Refactor library to artifact matching to not use pointers (#1172) 2024-02-05 15:29:45 +00:00