databricks-cli/internal/bundle/bundles
Andrew Nester 434bcbb018
Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591)
## Changes
This change allows to specify UC volumes path as an artifact paths so
all artifacts (JARs, wheels) are uploaded to UC Volumes.

Example configuration is here:
```
bundle:
  name: jar-bundle

workspace:
  host: https://foo.com
  artifact_path: /Volumes/main/default/foobar

artifacts:
  my_java_code:
    path: ./sample-java
    build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class"
    files:
      - source: ./sample-java/PrintArgs.jar

resources:
  jobs:
    jar_job:
      name: "Test Spark Jar Job"
      tasks:
        - task_key: TestSparkJarTask
          new_cluster:
            num_workers: 1
            spark_version: "14.3.x-scala2.12"
            node_type_id: "i3.xlarge"
          spark_jar_task:
            main_class_name: PrintArgs
          libraries:
            - jar: ./sample-java/PrintArgs.jar
```
## Tests
Manually + added E2E test for Java jobs

E2E test is temporarily skipped until auth related issues for UC for
tests are resolved
2024-07-16 08:57:04 +00:00
..
basic Correctly overwrite local state if remote state is newer (#1008) 2023-11-24 11:15:46 +00:00
deploy_then_remove_resources Don't merge-in remote resources during depolyments (#1432) 2024-05-15 12:41:44 +00:00
empty_bundle Make bundle deploy work if no resources are defined (#767) 2023-09-13 22:50:37 +00:00
job_metadata Persist deployment metadata in WSFS (#845) 2023-10-27 12:55:43 +00:00
python_wheel_task Make a notebook wrapper for Python wheel tasks optional (#797) 2023-09-26 14:32:20 +00:00
python_wheel_task_with_environments Added support for job environments (#1379) 2024-04-22 11:44:34 +00:00
spark_jar_task Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 2024-07-16 08:57:04 +00:00
with_includes Added `bundle deployment bind` and `unbind` command (#1131) 2024-02-14 18:04:45 +00:00