steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
databricks-cli/bundle/tests
History
Andrew Nester 56ed9bebf3
Added support for creating all-purpose clusters (#1698) 
## Changes
Added support for creating all-purpose clusters

Example of configuration

```
bundle:
  name: clusters

resources:
  clusters:
    test_cluster:
      cluster_name: "Test Cluster"
      num_workers: 2
      node_type_id: "i3.xlarge"
      autoscale:
        min_workers: 2
        max_workers: 7
      spark_version: "13.3.x-scala2.12"
      spark_conf:
        "spark.executor.memory": "2g"

  jobs:
    test_job:
      name: "Test Job"
      tasks:
        - task_key: test_task
          existing_cluster_id: ${resources.clusters.test_cluster.id}
          notebook_task:
            notebook_path: "./src/test.py"

targets:
    development:
      mode: development
      compute_id: ${resources.clusters.test_cluster.id}

```

## Tests
Added unit, config and E2E tests
 		2024-09-23 10:42:34 +00:00
..
autoload_git Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
basic First look for databricks.yml before falling back to bundle.yml (#580) 2023-07-18 12:16:34 +02:00
bundle_permissions Added support for top-level permissions (#928) 2023-11-13 11:29:40 +00:00
clusters Added support for creating all-purpose clusters (#1698) 2024-09-23 10:42:34 +00:00
environment_key_only Fixed seg fault when specifying environment key for tasks (#1443) 2024-05-21 10:00:04 +00:00
environment_overrides Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
environments_autoload_git Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
environments_job_and_pipeline Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
environments_override_job_cluster Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
git_branch_validation Fix bundle git branch validation (#645) 2023-08-07 17:29:02 +00:00
include_default Require include glob patterns to be explicitly defined (#602) 2023-07-25 10:00:46 +02:00
include_invalid First look for databricks.yml before falling back to bundle.yml (#580) 2023-07-18 12:16:34 +02:00
include_multiple Fixed panic when loading incorrectly defined jobs (#1402) 2024-05-17 10:10:17 +00:00
include_with_glob Fixed panic when loading incorrectly defined jobs (#1402) 2024-05-17 10:10:17 +00:00
interpolation First look for databricks.yml before falling back to bundle.yml (#580) 2023-07-18 12:16:34 +02:00
interpolation_target Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
job_and_pipeline Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
job_cluster_key Added validate mutator to surface additional bundle warnings (#1352) 2024-04-18 15:13:16 +00:00
job_with_spark_conf Test existing behavior when loading non-string spark conf values (#1071) 2023-12-18 11:22:22 +00:00
model_serving_endpoint Support Model Serving Endpoints in bundles (#682) 2023-09-07 21:54:31 +00:00
override_job_cluster Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
override_job_parameters Merge job parameters based on their name (#1659) 2024-08-06 16:12:18 +00:00
override_job_tasks Enable environment overrides for job tasks (#779) 2023-09-18 14:13:50 +00:00
override_pipeline_cluster Enable target overrides for pipeline clusters (#792) 2023-09-21 19:21:20 +00:00
path_translation Rewrite relative paths using `dyn.Location` of the underlying value (#1273) 2024-03-18 16:23:39 +00:00
pipeline_glob_paths Move bundle tests into bundle/tests (#1299) 2024-03-21 10:37:05 +00:00
presets Add configurable presets for name prefixes, tags, etc. (#1490) 2024-08-19 18:18:50 +00:00
python_wheel Expand library globs relative to the sync root (#1756) 2024-09-09 09:56:16 +00:00
quality_monitor Pause quality monitors when "mode: development" is used (#1481) 2024-06-19 13:54:35 +00:00
registered_model Support Unity Catalog Registered Models in bundles (#846) 2023-10-16 15:32:49 +00:00
relative_path_translation Retain location information of variable reference (#1333) 2024-04-03 10:40:29 +00:00
relative_path_with_includes Make resource and artifact paths in bundle config relative to config folder (#708) 2023-09-04 09:55:01 +00:00
run_as Compare `.Kind()` instead of direct equality checks on a `dyn.Value` (#1520) 2024-06-27 13:28:19 +00:00
sync Add paths field to bundle sync configuration (#1694) 2024-08-21 15:33:25 +00:00
target_empty Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
target_overrides Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
undefined_resources Report all empty resources present in error diagnostic (#1685) 2024-08-20 00:22:00 +00:00
validate Use dynamic walking to validate unique resource keys (#1614) 2024-07-29 13:04:02 +00:00
variables Fixed detecting full syntax variable override which includes type field (#1775) 2024-09-18 10:23:07 +00:00
yaml_anchors First look for databricks.yml before falling back to bundle.yml (#580) 2023-07-18 12:16:34 +02:00
yaml_anchors_separate_block Do not emit warning on YAML anchor blocks (#1354) 2024-04-10 09:55:02 +00:00
README.md Move mutator interface to top level bundle package (#105) 2022-11-28 10:59:43 +01:00
basic_test.go Move mutator interface to top level bundle package (#105) 2022-11-28 10:59:43 +01:00
bundle_permissions_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
clusters_test.go Added support for creating all-purpose clusters (#1698) 2024-09-23 10:42:34 +00:00
complex_variables_test.go Fixed detecting full syntax variable override which includes type field (#1775) 2024-09-18 10:23:07 +00:00
enviroment_key_test.go Upload local libraries even if they don't have artifact defined (#1664) 2024-08-14 09:03:44 +00:00
environment_git_test.go Improve token refresh flow (#1434) 2024-05-16 10:22:09 +00:00
environment_overrides_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
environments_job_and_pipeline_test.go Report all empty resources present in error diagnostic (#1685) 2024-08-20 00:22:00 +00:00
environments_override_job_cluster_test.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
git_test.go Improve token refresh flow (#1434) 2024-05-16 10:22:09 +00:00
include_test.go Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
interpolation_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
job_and_pipeline_test.go Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
job_cluster_key_test.go Added validate mutator to surface additional bundle warnings (#1352) 2024-04-18 15:13:16 +00:00
job_with_spark_conf_test.go Use dynamic configuration model in bundles (#1098) 2024-02-16 19:41:58 +00:00
loader.go Add paths field to bundle sync configuration (#1694) 2024-08-21 15:33:25 +00:00
model_serving_endpoint_test.go Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
override_job_cluster_test.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
override_job_parameters_test.go Merge job parameters based on their name (#1659) 2024-08-06 16:12:18 +00:00
override_job_tasks_test.go Enable environment overrides for job tasks (#779) 2023-09-18 14:13:50 +00:00
override_pipeline_cluster_test.go Enable target overrides for pipeline clusters (#792) 2023-09-21 19:21:20 +00:00
path_translation_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
pipeline_glob_paths_test.go Share test initializer in common helper function (#1695) 2024-08-20 12:54:56 +00:00
presets_test.go Add configurable presets for name prefixes, tags, etc. (#1490) 2024-08-19 18:18:50 +00:00
python_wheel_test.go Expand library globs relative to the sync root (#1756) 2024-09-09 09:56:16 +00:00
quality_monitor_test.go Pause quality monitors when "mode: development" is used (#1481) 2024-06-19 13:54:35 +00:00
registered_model_test.go Stop tracking file path locations in bundle resources (#1673) 2024-08-13 12:50:15 +00:00
relative_path_translation_test.go Share test initializer in common helper function (#1695) 2024-08-20 12:54:56 +00:00
relative_path_with_includes_test.go Return `diag.Diagnostics` from mutators (#1305) 2024-03-25 14:18:47 +00:00
run_as_test.go Compare `.Kind()` instead of direct equality checks on a `dyn.Value` (#1520) 2024-06-27 13:28:19 +00:00
suggest_target_test.go Improve `bundle validate` output (#1532) 2024-07-01 09:01:10 +00:00
sync_include_exclude_no_matches_test.go Added test for negation pattern in sync include exclude section (#1637) 2024-07-31 13:42:23 +00:00
sync_test.go Add paths field to bundle sync configuration (#1694) 2024-08-21 15:33:25 +00:00
target_empty_test.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
target_overrides_test.go Renamed `environments` to `targets` in bundle configuration (#670) 2023-08-17 15:22:32 +00:00
undefined_resources_test.go Report all empty resources present in error diagnostic (#1685) 2024-08-20 00:22:00 +00:00
validate_test.go Use dynamic walking to validate unique resource keys (#1614) 2024-07-29 13:04:02 +00:00
variables_test.go Added listing cluster filtering for cluster lookups (#1754) 2024-09-06 11:34:57 +00:00
yaml_anchors_test.go Do not emit warning on YAML anchor blocks (#1354) 2024-04-10 09:55:02 +00:00

README.md

Bundle configuration tests

Every test here uses an example bundle configuration. Each bundle configuration is located in a dedicated subdirectory.