databricks-cli/internal/bundle
Andrew Nester 48ff18e5fc
Upload local libraries even if they don't have artifact defined (#1664)
## Changes
Previously for all the libraries referenced in configuration DABs made
sure that there is corresponding artifact section.
But this is not really necessary and flexible, because local libraries
might be built outside of dabs context.
It also created difficult to follow logic in code where we back
referenced libraries to artifacts which was difficult to fllow


This PR does 3 things:
1. Allows all local libraries referenced in DABs config to be uploaded
to remote
2. Simplifies upload and glob references expand logic by doing this in
single place
3. Speed things up by uploading library only once and doing this in
parallel

## Tests
Added unit + integration tests + made sure that change is backward
compatible (no changes in existing tests)

---------

Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
2024-08-14 09:03:44 +00:00
..
bundles Run Spark JAR task test on multiple DBR versions (#1665) 2024-08-09 15:13:31 +00:00
artifacts_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
basic_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
bind_resource_test.go Added `bundle deployment bind` and `unbind` command (#1131) 2024-02-14 18:04:45 +00:00
deploy_test.go Add resource for UC schemas to DABs (#1413) 2024-07-31 12:16:28 +00:00
deploy_then_remove_resources_test.go Don't merge-in remote resources during depolyments (#1432) 2024-05-15 12:41:44 +00:00
deployment_state_test.go Added deployment state for bundles (#1267) 2024-03-18 14:41:58 +00:00
destroy_test.go Fix bundle destroy integration test (#1435) 2024-05-16 09:32:55 +00:00
empty_bundle_test.go Use `acc.WorkspaceTest` helper from bundle integration tests (#1181) 2024-02-07 11:18:56 +00:00
environments_test.go Added support for job environments (#1379) 2024-04-22 11:44:34 +00:00
generate_job_test.go Generate correct YAML if custom_tags or spark_conf is used for pipeline or job cluster configuration (#1210) 2024-02-15 15:03:19 +00:00
generate_pipeline_test.go Generate correct YAML if custom_tags or spark_conf is used for pipeline or job cluster configuration (#1210) 2024-02-15 15:03:19 +00:00
helpers.go Run Spark JAR task test on multiple DBR versions (#1665) 2024-08-09 15:13:31 +00:00
job_metadata_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
local_state_staleness_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
python_wheel_test.go Fix python wheel task integration tests (#1648) 2024-08-01 13:55:22 +00:00
spark_jar_test.go Run Spark JAR task test on multiple DBR versions (#1665) 2024-08-09 15:13:31 +00:00
validate_test.go Serialize dynamic value for `bundle validate` output (#1499) 2024-06-18 15:04:20 +00:00