databricks-cli

Commit Graph

Author	SHA1	Message	Date
Andrew Nester	56ed9bebf3	Added support for creating all-purpose clusters (#1698 ) ## Changes Added support for creating all-purpose clusters Example of configuration ``` bundle: name: clusters resources: clusters: test_cluster: cluster_name: "Test Cluster" num_workers: 2 node_type_id: "i3.xlarge" autoscale: min_workers: 2 max_workers: 7 spark_version: "13.3.x-scala2.12" spark_conf: "spark.executor.memory": "2g" jobs: test_job: name: "Test Job" tasks: - task_key: test_task existing_cluster_id: ${resources.clusters.test_cluster.id} notebook_task: notebook_path: "./src/test.py" targets: development: mode: development compute_id: ${resources.clusters.test_cluster.id} ``` ## Tests Added unit, config and E2E tests	2024-09-23 10:42:34 +00:00
shreyas-goenka	4ac1c1655b	Fix CLI nightlies on our UC workspaces (#1225 ) This PR fixes some test helper functions so that they work properly on our test environments for AWS and Azure UC workspaces.	2024-02-21 13:06:03 +00:00
Pieter Noordhuis	3685eb16f4	Run tests to verify backend tag validation behavior (#814 ) ## Changes Validation rules on tags are different per cloud (they are passed through to the underlying clusters and as such must comply with cloud-specific validation rules). This change adds tests to confirm the current behavior to ensure the normalization we can apply is in line with how the backend behaves. ## Tests The new integration tests pass (tested locally).	2023-09-29 08:38:06 +00:00

Author

SHA1

Message

Date

Andrew Nester

56ed9bebf3

Added support for creating all-purpose clusters (#1698 )

## Changes
Added support for creating all-purpose clusters

Example of configuration

```
bundle:
  name: clusters

resources:
  clusters:
    test_cluster:
      cluster_name: "Test Cluster"
      num_workers: 2
      node_type_id: "i3.xlarge"
      autoscale:
        min_workers: 2
        max_workers: 7
      spark_version: "13.3.x-scala2.12"
      spark_conf:
        "spark.executor.memory": "2g"

  jobs:
    test_job:
      name: "Test Job"
      tasks:
        - task_key: test_task
          existing_cluster_id: ${resources.clusters.test_cluster.id}
          notebook_task:
            notebook_path: "./src/test.py"

targets:
    development:
      mode: development
      compute_id: ${resources.clusters.test_cluster.id}

```

## Tests
Added unit, config and E2E tests

2024-09-23 10:42:34 +00:00

shreyas-goenka

4ac1c1655b

Fix CLI nightlies on our UC workspaces (#1225 )

This PR fixes some test helper functions so that they work properly on
our test environments for AWS and Azure UC workspaces.

2024-02-21 13:06:03 +00:00

Pieter Noordhuis

3685eb16f4

Run tests to verify backend tag validation behavior (#814 )

## Changes

Validation rules on tags are different per cloud (they are passed
through to the underlying clusters and as such must comply with
cloud-specific validation rules). This change adds tests to confirm the
current behavior to ensure the normalization we can apply is in line
with how the backend behaves.

## Tests

The new integration tests pass (tested locally).

2023-09-29 08:38:06 +00:00

3 Commits