databricks-cli

Commit Graph

Author	SHA1	Message	Date
Pieter Noordhuis	a240be0b5a	Run Spark JAR task test on multiple DBR versions (#1665 ) ## Changes This explores error messages on older DBRs and UC vs non-UC. ## Tests Integration tests pass.	2024-08-09 15:13:31 +00:00
Andrew Nester	9d1fbbb39c	Enable Spark JAR task test (#1658 ) ## Changes Enable Spark JAR task test ## Tests ``` Updating deployment state... Deleting files... Destroy complete! --- PASS: TestAccSparkJarTaskDeployAndRunOnVolumes (194.13s) PASS coverage: 51.9% of statements in ./... ok github.com/databricks/cli/internal/bundle 194.586s coverage: 51.9% of statements in ./... ```	2024-08-06 18:58:34 +00:00
Andrew Nester	434bcbb018	Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591 ) ## Changes This change allows to specify UC volumes path as an artifact paths so all artifacts (JARs, wheels) are uploaded to UC Volumes. Example configuration is here: ``` bundle: name: jar-bundle workspace: host: https://foo.com artifact_path: /Volumes/main/default/foobar artifacts: my_java_code: path: ./sample-java build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class" files: - source: ./sample-java/PrintArgs.jar resources: jobs: jar_job: name: "Test Spark Jar Job" tasks: - task_key: TestSparkJarTask new_cluster: num_workers: 1 spark_version: "14.3.x-scala2.12" node_type_id: "i3.xlarge" spark_jar_task: main_class_name: PrintArgs libraries: - jar: ./sample-java/PrintArgs.jar ``` ## Tests Manually + added E2E test for Java jobs E2E test is temporarily skipped until auth related issues for UC for tests are resolved	2024-07-16 08:57:04 +00:00

Author

SHA1

Message

Date

Pieter Noordhuis

a240be0b5a

Run Spark JAR task test on multiple DBR versions (#1665 )

## Changes

This explores error messages on older DBRs and UC vs non-UC.

## Tests

Integration tests pass.

2024-08-09 15:13:31 +00:00

Andrew Nester

9d1fbbb39c

Enable Spark JAR task test (#1658 )

## Changes
Enable Spark JAR task test

## Tests
```

Updating deployment state...
Deleting files...
Destroy complete!
--- PASS: TestAccSparkJarTaskDeployAndRunOnVolumes (194.13s)
PASS
coverage: 51.9% of statements in ./...
ok      github.com/databricks/cli/internal/bundle       194.586s        coverage: 51.9% of statements in ./...
```

2024-08-06 18:58:34 +00:00

Andrew Nester

434bcbb018

Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591 )

## Changes
This change allows to specify UC volumes path as an artifact paths so
all artifacts (JARs, wheels) are uploaded to UC Volumes.

Example configuration is here:
```
bundle:
  name: jar-bundle

workspace:
  host: https://foo.com
  artifact_path: /Volumes/main/default/foobar

artifacts:
  my_java_code:
    path: ./sample-java
    build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class"
    files:
      - source: ./sample-java/PrintArgs.jar

resources:
  jobs:
    jar_job:
      name: "Test Spark Jar Job"
      tasks:
        - task_key: TestSparkJarTask
          new_cluster:
            num_workers: 1
            spark_version: "14.3.x-scala2.12"
            node_type_id: "i3.xlarge"
          spark_jar_task:
            main_class_name: PrintArgs
          libraries:
            - jar: ./sample-java/PrintArgs.jar
```
## Tests
Manually + added E2E test for Java jobs

E2E test is temporarily skipped until auth related issues for UC for
tests are resolved

2024-07-16 08:57:04 +00:00

3 Commits