steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
databricks-cli/internal/bundle
History
Andrew Nester 434bcbb018
Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 
## Changes
This change allows to specify UC volumes path as an artifact paths so
all artifacts (JARs, wheels) are uploaded to UC Volumes.

Example configuration is here:
```
bundle:
  name: jar-bundle

workspace:
  host: https://foo.com
  artifact_path: /Volumes/main/default/foobar

artifacts:
  my_java_code:
    path: ./sample-java
    build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class"
    files:
      - source: ./sample-java/PrintArgs.jar

resources:
  jobs:
    jar_job:
      name: "Test Spark Jar Job"
      tasks:
        - task_key: TestSparkJarTask
          new_cluster:
            num_workers: 1
            spark_version: "14.3.x-scala2.12"
            node_type_id: "i3.xlarge"
          spark_jar_task:
            main_class_name: PrintArgs
          libraries:
            - jar: ./sample-java/PrintArgs.jar
```
## Tests
Manually + added E2E test for Java jobs

E2E test is temporarily skipped until auth related issues for UC for
tests are resolved
 		2024-07-16 08:57:04 +00:00
..
bundles Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 2024-07-16 08:57:04 +00:00
artifacts_test.go Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 2024-07-16 08:57:04 +00:00
basic_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
bind_resource_test.go Added `bundle deployment bind` and `unbind` command (#1131) 2024-02-14 18:04:45 +00:00
deploy_then_remove_resources_test.go Don't merge-in remote resources during depolyments (#1432) 2024-05-15 12:41:44 +00:00
deployment_state_test.go Added deployment state for bundles (#1267) 2024-03-18 14:41:58 +00:00
destroy_test.go Fix bundle destroy integration test (#1435) 2024-05-16 09:32:55 +00:00
empty_bundle_test.go Use `acc.WorkspaceTest` helper from bundle integration tests (#1181) 2024-02-07 11:18:56 +00:00
environments_test.go Added support for job environments (#1379) 2024-04-22 11:44:34 +00:00
generate_job_test.go Generate correct YAML if custom_tags or spark_conf is used for pipeline or job cluster configuration (#1210) 2024-02-15 15:03:19 +00:00
generate_pipeline_test.go Generate correct YAML if custom_tags or spark_conf is used for pipeline or job cluster configuration (#1210) 2024-02-15 15:03:19 +00:00
helpers.go Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 2024-07-16 08:57:04 +00:00
job_metadata_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
local_state_staleness_test.go Update Spark version in integration tests to 13.3 (#1375) 2024-04-19 11:31:54 +00:00
python_wheel_test.go Added support for job environments (#1379) 2024-04-22 11:44:34 +00:00
spark_jar_test.go Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591) 2024-07-16 08:57:04 +00:00
validate_test.go Serialize dynamic value for `bundle validate` output (#1499) 2024-06-18 15:04:20 +00:00