mirror of https://github.com/databricks/cli.git
1011 Commits
| Author | SHA1 | Message | Date |
|---|---|---|---|
Pieter Noordhuis
|
51c64ef82a
|
Release v0.212.0 (#1116)
CLI: * Tweak command groups in CLI help ([#1092](https://github.com/databricks/cli/pull/1092)). * Fixed storage-credentials list command in text output ([#1094](https://github.com/databricks/cli/pull/1094)). * Allow account client auth with environment variables when no `.databrickscfg` file present ([#1097](https://github.com/databricks/cli/pull/1097)). * Always log with text format by default ([#1096](https://github.com/databricks/cli/pull/1096)). Bundles: * Added exec.NewCommandExecutor to execute commands with correct interpreter ([#1075](https://github.com/databricks/cli/pull/1075)). * Use resource key as name in permissions code ([#1087](https://github.com/databricks/cli/pull/1087)). * Add support for reprompts if user input does not match template schema ([#946](https://github.com/databricks/cli/pull/946)). * Improve experience for multiple builtin templates ([#1052](https://github.com/databricks/cli/pull/1052)). * Improve error when bundle root is not writable ([#1093](https://github.com/databricks/cli/pull/1093)). * Change recommended production deployment path from `/Shared` to `/Users` ([#1091](https://github.com/databricks/cli/pull/1091)). * Allow referencing bundle resources by name ([#872](https://github.com/databricks/cli/pull/872)). * Make libs/exec fallback to `sh` if `bash` cannot be found ([#1114](https://github.com/databricks/cli/pull/1114)). Internal: * Functionality to walk a `config.Value` tree ([#1081](https://github.com/databricks/cli/pull/1081)). * Rename libs/config -> libs/dyn ([#1086](https://github.com/databricks/cli/pull/1086)). * Added codecov integration on code push ([#1095](https://github.com/databricks/cli/pull/1095)). * Consolidate functions to convert `dyn.Value` to native types ([#1100](https://github.com/databricks/cli/pull/1100)). * Define constant for the invalid `dyn.Value` ([#1101](https://github.com/databricks/cli/pull/1101)). API Changes: * Changed `databricks serving-endpoints update-config` command with new required argument order. * Changed `databricks account ip-access-lists create` command with new required argument order. * Changed `databricks account ip-access-lists replace` command with new required argument order. * Changed `databricks account ip-access-lists update` command with new required argument order. * Changed `databricks ip-access-lists create` command with new required argument order. * Changed `databricks ip-access-lists replace` command with new required argument order. * Changed `databricks ip-access-lists update` command with new required argument order. OpenAPI commit a7a9dc025bb80303e676bf3708942c6aa06689f1 (2024-01-04) Dependency updates: * Bump github.com/hashicorp/terraform-exec from 0.19.0 to 0.20.0 ([#1088](https://github.com/databricks/cli/pull/1088)). * Bump go.uber.org/mock from 0.3.0 to 0.4.0 ([#1089](https://github.com/databricks/cli/pull/1089)). * Bump github.com/hashicorp/terraform-json from 0.18.0 to 0.20.0 ([#1090](https://github.com/databricks/cli/pull/1090)). * Bump golang.org/x/term from 0.15.0 to 0.16.0 ([#1103](https://github.com/databricks/cli/pull/1103)). * Bump github.com/cloudflare/circl from 1.3.3 to 1.3.7 ([#1105](https://github.com/databricks/cli/pull/1105)). * Bump golang.org/x/sync from 0.5.0 to 0.6.0 ([#1104](https://github.com/databricks/cli/pull/1104)). * Upgrade golang.org/x/crypto to v0.17.0 in internal module ([#1110](https://github.com/databricks/cli/pull/1110)). * Upgrade Go SDK to v0.29.0 ([#1111](https://github.com/databricks/cli/pull/1111)). |
|
|
Pieter Noordhuis
|
94112eaedb
|
Make libs/exec fallback to `sh` if `bash` cannot be found (#1114)
## Changes Falling back to `sh` is also what GitHub Actions do if `bash` is not found in the path. It is possible `bash` is not available when running from minimal Docker containers and we must not error out in this case. See: https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsshell. This change renames `interpreter` -> `shell`. ## Tests Unit tests pass. |
|
|
Pieter Noordhuis
|
3c76a11d00
|
Upgrade Go SDK to v0.29.0 (#1111)
## Changes See: * https://github.com/databricks/databricks-sdk-go/releases/tag/v0.29.0 * https://github.com/databricks/databricks-sdk-go/releases/tag/v0.28.0 ## Tests Unit and integration tests pass. |
|
|
Pieter Noordhuis
|
f5c46478f4
|
Upgrade golang.org/x/crypto to v0.17.0 in internal module (#1110)
## Changes This addresses https://github.com/databricks/cli/security/dependabot/12. |
|
dependabot[bot]
|
1604ada0e6
|
Bump golang.org/x/sync from 0.5.0 to 0.6.0 (#1104)
Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.5.0 to
0.6.0.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="
|
|
|
dependabot[bot]
|
58e4bb9de3
|
Bump github.com/cloudflare/circl from 1.3.3 to 1.3.7 (#1105)
Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl) from 1.3.3 to 1.3.7. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/cloudflare/circl/releases">github.com/cloudflare/circl's releases</a>.</em></p> <blockquote> <h2>CIRCL v1.3.7</h2> <h3>What's Changed</h3> <ul> <li>build(deps): bump golang.org/x/crypto from 0.3.1-0.20221117191849-2c476679df9a to 0.17.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/467">cloudflare/circl#467</a></li> <li>kyber: remove division by q in ciphertext compression by <a href="https://github.com/bwesterb"><code>@bwesterb</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/468">cloudflare/circl#468</a></li> <li>Releasing CIRCL v1.3.7 by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/469">cloudflare/circl#469</a></li> </ul> <h3>New Contributors</h3> <ul> <li><a href="https://github.com/dependabot"><code>@dependabot</code></a> made their first contribution in <a href="https://redirect.github.com/cloudflare/circl/pull/467">cloudflare/circl#467</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/cloudflare/circl/compare/v1.3.6...v1.3.7">https://github.com/cloudflare/circl/compare/v1.3.6...v1.3.7</a></p> <h2>CIRCL v1.3.6</h2> <h3>What's Changed</h3> <ul> <li>internal: add TurboShake{128,256} by <a href="https://github.com/bwesterb"><code>@bwesterb</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/430">cloudflare/circl#430</a></li> <li>Kangaroo12 draft -10 by <a href="https://github.com/bwesterb"><code>@bwesterb</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/431">cloudflare/circl#431</a></li> <li>Add K12 as XOF by <a href="https://github.com/bwesterb"><code>@bwesterb</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/437">cloudflare/circl#437</a></li> <li>xof/k12: Fix a typo in the package documentation by <a href="https://github.com/cjpatton"><code>@cjpatton</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/438">cloudflare/circl#438</a></li> <li>Set CIRCL version for generated assembler code. by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/440">cloudflare/circl#440</a></li> <li>Add tkn20 benchmarks by <a href="https://github.com/tanyav2"><code>@tanyav2</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/442">cloudflare/circl#442</a></li> <li>Add partially blind RSA implementation by <a href="https://github.com/chris-wood"><code>@chris-wood</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/445">cloudflare/circl#445</a></li> <li>Update doc.go by <a href="https://github.com/nadimkobeissi"><code>@nadimkobeissi</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/447">cloudflare/circl#447</a></li> <li>tss/rsa: key generation for threshold RSA (safe primes) by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/450">cloudflare/circl#450</a></li> <li>Bumping Go version for CI jobs. by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/457">cloudflare/circl#457</a></li> <li>Spelling by <a href="https://github.com/jsoref"><code>@jsoref</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/456">cloudflare/circl#456</a></li> <li>blindrsa: updating blindrsa to be compliant with RFC9474 by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/464">cloudflare/circl#464</a></li> <li>Releasing CIRCL v1.3.6 by <a href="https://github.com/armfazh"><code>@armfazh</code></a> in <a href="https://redirect.github.com/cloudflare/circl/pull/465">cloudflare/circl#465</a></li> </ul> <h3>New Contributors</h3> <ul> <li><a href="https://github.com/nadimkobeissi"><code>@nadimkobeissi</code></a> made their first contribution in <a href="https://redirect.github.com/cloudflare/circl/pull/447">cloudflare/circl#447</a></li> <li><a href="https://github.com/jsoref"><code>@jsoref</code></a> made their first contribution in <a href="https://redirect.github.com/cloudflare/circl/pull/456">cloudflare/circl#456</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/cloudflare/circl/compare/v1.3.3...v1.3.6">https://github.com/cloudflare/circl/compare/v1.3.3...v1.3.6</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
dependabot[bot]
|
c8cdebd433
|
Bump golang.org/x/term from 0.15.0 to 0.16.0 (#1103)
Bumps [golang.org/x/term](https://github.com/golang/term) from 0.15.0 to
0.16.0.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="
|
|
|
Pieter Noordhuis
|
d8a64e6617
|
Define constant for the invalid `dyn.Value` (#1101)
## Changes The nil value is a real valid value that we need to represent. To accommodate this we introduced `dyn.KindInvalid` as the zero-value for `dyn.Kind` (see #904), but did not yet update the comments on `dyn.NilValue` or add tests for `kind.go`. This also moves `KindNil` to be last in the definition order (least likely to care about it). ## Tests Tests pass. |
|
|
Pieter Noordhuis
|
bae220d1bc
|
Consolidate functions to convert `dyn.Value` to native types (#1100)
## Changes The file `value.go` had a couple `AsZZZ` and `MustZZZ` functions. This change backfills missing versions and moves all of them to a separate file. ## Tests Tests pass; full coverage. |
|
Andrew Nester
|
4b01fff03d
|
Fixed instance pool resolving by name (#1102)
## Changes Fixed instance pool resolving by name ## Tests Added regression test |
|
|
Andrew Nester
|
5fb40f9d07
|
Allow referencing bundle resources by name (#872)
## Changes
Now we can define variables with values which reference different
Databricks resources by name.
When references like this, DABs automatically looks up the resource by
this name and replaces the reference with ID of the resource referenced.
Thus when the variable is used in the configuration it will contain the
correct resolved ID of resource.
The resolvers are code generated and thus DABs support referencing all
resources which has `GetByName`-like methods in Go SDK.
### Example
```
variables:
my_cluster_id:
description: An existing cluster.
lookup:
cluster: "12.2 shared"
resources:
jobs:
my_job:
name: "My Job"
tasks:
- task_key: TestTask
existing_cluster_id: ${var.my_cluster_id}
targets:
dev:
variables:
my_cluster_id:
lookup:
cluster: "dev-cluster"
```
## Tests
Added unit test + manual testing
---------
Co-authored-by: shreyas-goenka <88374338+shreyas-goenka@users.noreply.github.com>
|
|
Miles Yucht
|
8a1be76910
|
Always log with text format by default (#1096)
## Changes The JSON logger is excellent as a machine-readable logger with lots of metadata, but the resulting logs are difficult to read: <img width="1601" alt="Image_from_Databricks" src="https://github.com/databricks/cli/assets/1850319/76aa852f-756f-4e0a-bc00-3a6e3224296a"> Currently, we only use the friendly log printer when run from a TTY. This PR removes that restriction, so logs will be pretty-printed by default, regardless of TTY or not. If a user needs machine-readable logs, they can still use `--log-format JSON`. ## Tests Manual test: `databricks current-user me --debug | cat` uses the pretty-printing logger.  |
|
Lennart Kats (databricks)
|
167deec8c3
|
Change recommended production deployment path from /Shared to /Users (#1091)
## Changes This PR changes the default and `mode: production` recommendation to target `/Users` for deployment. Previously, we used `/Shared`, but because of a lack of POSIX-like permissions in WorkspaceFS this meant that files inside would be readable and writable by other users in the workspace. Detailed change: * `default-python` no longer uses a path that starts with `/Shared` * `mode: production` no longer requires a path that starts with `/Shared` ## Related PRs Docs: https://github.com/databricks/docs/pull/14585 Examples: https://github.com/databricks/bundle-examples/pull/17 ## Tests * Manual tests * Template unit tests (with an extra check to avoid /Shared) |
|
|
Andrew Nester
|
e80882b5af
|
Allow account client auth with environment variables when no .databrickscfg file present (#1097)
## Changes Allow account client auth with environment variables when no .databrickscfg file present Makes the behaviour to be in line with WorkspaceClient auth. ## Tests Added regression test |
|
|
Andrew Nester
|
9cb098506a
|
Added codecov integration on code push (#1095)
Added codecov integration on code push |
|
|
Andrew Nester
|
3e6e04831f
|
Fixed storage-credentials list command in text output (#1094)
## Changes Fixes #1029 Closes #910 ## Tests Added regression test |
|
|
Lennart Kats (databricks)
|
9a1f078bd9
|
Improve error when bundle root is not writable (#1093)
## Changes This improves the error when deploying to a bundle root that the current user doesn't have write access to. This can come up slightly more often since the change of https://github.com/databricks/cli/pull/1091. Before this change: ``` $ databricks bundle deploy --target prod Building my_project... Error: no such directory: /Users/lennart.kats@databricks.com/.bundle/my_project/prod/state ``` After this change: ``` $ databricks bundle deploy --target prod Building my_project... Error: cannot write to deployment root (this can indicate a previous deploy was done with a different identity): /Users/lennart.kats@databricks.com/.bundle/my_project/prod ``` Note that this change uses the "no such directory" error returned from the filer. |
|
|
Lennart Kats (databricks)
|
206b1bf198
|
Tweak command groups in CLI help (#1092)
## Changes This tweaks the help output shown when using `databricks help`: * make`jobs` appears under `Workflows` (as done in baseline OpenAPI). * move `bundle` and `sync` under a new group called `Developer Tools` (similar to what we have in docs) * minor wording changes |
|
|
dependabot[bot]
|
3b6681c301
|
Bump github.com/hashicorp/terraform-json from 0.18.0 to 0.20.0 (#1090)
Bumps [github.com/hashicorp/terraform-json](https://github.com/hashicorp/terraform-json) from 0.18.0 to 0.20.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/hashicorp/terraform-json/releases">github.com/hashicorp/terraform-json's releases</a>.</em></p> <blockquote> <h2>v0.20.0</h2> <p>ENHANCEMENTS:</p> <ul> <li>Add <code>ReplacePaths</code> to <code>Change</code> struct by <a href="https://github.com/sebasslash"><code>@sebasslash</code></a> in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/117">hashicorp/terraform-json#117</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/hashicorp/terraform-json/compare/v0.19.0...v0.20.0">https://github.com/hashicorp/terraform-json/compare/v0.19.0...v0.20.0</a></p> <h2>v0.19.0</h2> <p>ENHANCEMENTS:</p> <ul> <li>Add <code>UseJSONNumber</code> field and <code>UseJSONNumber()</code> method to <code>Plan</code> to allow use of <code>json.Number</code> for numerical values by <a href="https://github.com/bendbennett"><code>@bendbennett</code></a> in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/113">hashicorp/terraform-json#113</a></li> </ul> <p>INTERNAL:</p> <ul> <li>github: Disable dependabot for GHA by <a href="https://github.com/radeksimko"><code>@radeksimko</code></a> in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/114">hashicorp/terraform-json#114</a></li> <li>build(deps): Bump workflows to latest trusted versions by <a href="https://github.com/hashicorp-tsccr"><code>@hashicorp-tsccr</code></a> in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/115">hashicorp/terraform-json#115</a></li> <li>build(deps): Bump workflows to latest trusted versions by <a href="https://github.com/hashicorp-tsccr"><code>@hashicorp-tsccr</code></a> in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/116">hashicorp/terraform-json#116</a></li> </ul> <p>New Contributors</p> <ul> <li><a href="https://github.com/bendbennett"><code>@bendbennett</code></a> made their first contribution in <a href="https://redirect.github.com/hashicorp/terraform-json/pull/113">hashicorp/terraform-json#113</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/hashicorp/terraform-json/compare/v0.18.0...v0.19.0">https://github.com/hashicorp/terraform-json/compare/v0.18.0...v0.19.0</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
dependabot[bot]
|
0c850ddab5
|
Bump go.uber.org/mock from 0.3.0 to 0.4.0 (#1089)
Bumps [go.uber.org/mock](https://github.com/uber/mock) from 0.3.0 to 0.4.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/uber/mock/releases">go.uber.org/mock's releases</a>.</em></p> <blockquote> <h2>v0.4.0</h2> <h2>0.4.0 (20 Dec 2023)</h2> <h3>Added</h3> <ul> <li><a href="https://redirect.github.com/uber/mock/issues/63">#63</a>[]: <code>AnyOf</code> matcher for values that satisfy at least one matcher.</li> <li><a href="https://redirect.github.com/uber/mock/issues/114">#114</a>[]: <code>Regex</code> matcher.</li> </ul> <h3>Fixed</h3> <ul> <li><a href="https://redirect.github.com/uber/mock/issues/93">#93</a>[]: Ignore interfaces that contain type constraints.</li> <li><a href="https://redirect.github.com/uber/mock/issues/101">#101</a>[]: Fix race condition on Controller.Satisfied.</li> <li><a href="https://redirect.github.com/uber/mock/issues/121">#121</a>[]: Fix paths for windows.</li> <li><a href="https://redirect.github.com/uber/mock/issues/127">#127</a>[]: Propogate -mock_names to Recorder and ReturnCall types.</li> <li><a href="https://redirect.github.com/uber/mock/issues/132">#132</a>[]: Sanitize "any" package names.</li> </ul> <p><a href="https://redirect.github.com/uber/mock/issues/63">#63</a>: <a href="https://redirect.github.com/uber-go/mock/pull/63">uber-go/mock#63</a> <a href="https://redirect.github.com/uber/mock/issues/93">#93</a>: <a href="https://redirect.github.com/uber-go/mock/pull/93">uber-go/mock#93</a> <a href="https://redirect.github.com/uber/mock/issues/101">#101</a>: <a href="https://redirect.github.com/uber-go/mock/pull/101">uber-go/mock#101</a> <a href="https://redirect.github.com/uber/mock/issues/114">#114</a>: <a href="https://redirect.github.com/uber-go/mock/pull/114">uber-go/mock#114</a> <a href="https://redirect.github.com/uber/mock/issues/121">#121</a>: <a href="https://redirect.github.com/uber-go/mock/pull/121">uber-go/mock#121</a> <a href="https://redirect.github.com/uber/mock/issues/127">#127</a>: <a href="https://redirect.github.com/uber-go/mock/pull/127">uber-go/mock#127</a> <a href="https://redirect.github.com/uber/mock/issues/132">#132</a>: <a href="https://redirect.github.com/uber-go/mock/pull/132">uber-go/mock#132</a></p> <p>Thanks to <a href="https://github.com/favonia"><code>@favonia</code></a> <a href="https://github.com/hoonmin"><code>@hoonmin</code></a> <a href="https://github.com/pshopper"><code>@pshopper</code></a> <a href="https://github.com/davidharrigan"><code>@davidharrigan</code></a> <a href="https://github.com/dlsniper"><code>@dlsniper</code></a> <a href="https://github.com/merrett010"><code>@merrett010</code></a> <a href="https://github.com/craig65535"><code>@craig65535</code></a> <a href="https://github.com/chemidy"><code>@chemidy</code></a> <a href="https://github.com/tulzke"><code>@tulzke</code></a> <a href="https://github.com/UnAfraid"><code>@UnAfraid</code></a> <a href="https://github.com/JacobOaks"><code>@JacobOaks</code></a> <a href="https://github.com/sywhang"><code>@sywhang</code></a> for their contributions this release.</p> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/uber-go/mock/blob/main/CHANGELOG.md">go.uber.org/mock's changelog</a>.</em></p> <blockquote> <h2>0.4.0 (20 Dec 2023)</h2> <h3>Added</h3> <ul> <li><a href="https://redirect.github.com/uber/mock/issues/63">#63</a>[]: <code>AnyOf</code> matcher for values that satisfy at least one matcher.</li> <li><a href="https://redirect.github.com/uber/mock/issues/114">#114</a>[]: <code>Regex</code> matcher.</li> </ul> <h3>Fixed</h3> <ul> <li><a href="https://redirect.github.com/uber/mock/issues/93">#93</a>[]: Ignore interfaces that contain type constraints.</li> <li><a href="https://redirect.github.com/uber/mock/issues/101">#101</a>[]: Fix race condition on Controller.Satisfied.</li> <li><a href="https://redirect.github.com/uber/mock/issues/121">#121</a>[]: Fix paths for windows.</li> <li><a href="https://redirect.github.com/uber/mock/issues/127">#127</a>[]: Propogate -mock_names to Recorder and ReturnCall types.</li> <li><a href="https://redirect.github.com/uber/mock/issues/132">#132</a>[]: Sanitize "any" package names.</li> </ul> <p><a href="https://redirect.github.com/uber/mock/issues/63">#63</a>: <a href="https://redirect.github.com/uber-go/mock/pull/63">uber-go/mock#63</a> <a href="https://redirect.github.com/uber/mock/issues/93">#93</a>: <a href="https://redirect.github.com/uber-go/mock/pull/93">uber-go/mock#93</a> <a href="https://redirect.github.com/uber/mock/issues/101">#101</a>: <a href="https://redirect.github.com/uber-go/mock/pull/101">uber-go/mock#101</a> <a href="https://redirect.github.com/uber/mock/issues/114">#114</a>: <a href="https://redirect.github.com/uber-go/mock/pull/114">uber-go/mock#114</a> <a href="https://redirect.github.com/uber/mock/issues/121">#121</a>: <a href="https://redirect.github.com/uber-go/mock/pull/121">uber-go/mock#121</a> <a href="https://redirect.github.com/uber/mock/issues/127">#127</a>: <a href="https://redirect.github.com/uber-go/mock/pull/127">uber-go/mock#127</a> <a href="https://redirect.github.com/uber/mock/issues/132">#132</a>: <a href="https://redirect.github.com/uber-go/mock/pull/132">uber-go/mock#132</a></p> <p>Thanks to <a href="https://github.com/favonia"><code>@favonia</code></a> <a href="https://github.com/hoonmin"><code>@hoonmin</code></a> <a href="https://github.com/pshopper"><code>@pshopper</code></a> <a href="https://github.com/davidharrigan"><code>@davidharrigan</code></a> <a href="https://github.com/dlsniper"><code>@dlsniper</code></a> <a href="https://github.com/merrett010"><code>@merrett010</code></a> <a href="https://github.com/craig65535"><code>@craig65535</code></a> <a href="https://github.com/chemidy"><code>@chemidy</code></a> <a href="https://github.com/tulzke"><code>@tulzke</code></a> <a href="https://github.com/UnAfraid"><code>@UnAfraid</code></a> <a href="https://github.com/JacobOaks"><code>@JacobOaks</code></a> <a href="https://github.com/sywhang"><code>@sywhang</code></a> for their contributions this release.</p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
dependabot[bot]
|
c6a2ce6ea8
|
Bump github.com/hashicorp/terraform-exec from 0.19.0 to 0.20.0 (#1088)
Bumps [github.com/hashicorp/terraform-exec](https://github.com/hashicorp/terraform-exec) from 0.19.0 to 0.20.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/hashicorp/terraform-exec/releases">github.com/hashicorp/terraform-exec's releases</a>.</em></p> <blockquote> <h2>v0.20.0</h2> <p>ENHANCEMENTS:</p> <ul> <li>Add JSONNumber option to Show to enable json.Number representation of numerical values in returned tfjson.Plan and tfjson.State values (<a href="https://redirect.github.com/hashicorp/terraform-exec/pull/427">hashicorp/terraform-exec#427</a>)</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/hashicorp/terraform-exec/blob/main/CHANGELOG.md">github.com/hashicorp/terraform-exec's changelog</a>.</em></p> <blockquote> <h1>0.20.0 (December 20, 2023)</h1> <p>ENHANCEMENTS:</p> <ul> <li>Add <code>JSONNumber</code> option to <code>Show</code> to enable <code>json.Number</code> representation of numerical values in returned <code>tfjson.Plan</code> and <code>tfjson.State</code> values (<a href="https://redirect.github.com/hashicorp/terraform-exec/pull/427">#427</a>)</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
Lennart Kats (databricks)
|
10a8ce4562
|
Improve experience for multiple builtin templates (#1052)
## Changes This enhances the template selection experience a bit as we add more and more built-in templates (like https://github.com/databricks/cli/pull/1051 and https://github.com/databricks/cli/pull/1059): ### New experience: <img width="661" alt="image" src="https://github.com/databricks/cli/assets/58432911/afe3b84d-8a77-47f3-b9c2-f827f7893cd7"> ### Current experience: <img width="265" alt="image" src="https://github.com/databricks/cli/assets/58432911/36f8d568-819f-4920-83b1-fb76109ea3d1"> --------- Co-authored-by: shreyas-goenka <88374338+shreyas-goenka@users.noreply.github.com> |
|
shreyas-goenka
|
f2408eda62
|
Add support for reprompts if user input does not match template schema (#946)
## Changes This PR adds retry logic to user input prompts, prompting users again if the value does not match the requirements specified in the bundle template schema. ## Tests Manually. Here's an example UX. The first prompt expects an integer and the second one a string made only from the letters "defg" ``` shreyas.goenka@THW32HFW6T cli % cli bundle init ~/mlops-stack Please enter an integer [123]: abc Validation failed: "abc" is not a integer Please enter an integer [123]: 123 Please enter a string [dddd]: apple Validation failed: invalid value for input_root_dir: "apple". Only characters the 'd', 'e', 'f', 'g' are allowed ``` |
|
|
Pieter Noordhuis
|
fa3c8b1017
|
Use resource key as name in permissions code (#1087)
## Changes The code relied on the `Name` property being accessible for every resource. This is generally true, but because these property structs are embedded as pointer, they can be nil. This is also why the tests had to initialize the embedded struct to pass. This changes the approach to use the keys from the resource map instead, so that we no longer rely on the non-nil embedded struct. Note: we should evaluate whether we should turn these into values instead of pointers. I don't recall if we get value from them being pointers. ## Tests Unit tests pass. |
|
|
Pieter Noordhuis
|
938eb1600c
|
Rename libs/config -> libs/dyn (#1086)
## Changes The name "dynamic value", or "dyn" for short, is more descriptive than the opaque "config". Also, it conveniently does not alias with other packages in the repository, or (popular ones) elsewhere. (discussed with @andrewnester) ## Tests n/a |
|
|
Pieter Noordhuis
|
a1297d71fd
|
Functionality to walk a `config.Value` tree (#1081)
## Changes This change adds: * A `config.Walk` function to walk a configuration tree * A `config.Path` type to represent a value's path inside a tree * Functions to create a `config.Path` from a string, or convert one to a string ## Tests Additional unit tests with full coverage. |
|
|
Andrew Nester
|
ac37a592f1
|
Added exec.NewCommandExecutor to execute commands with correct interpreter (#1075)
## Changes Instead of handling command chaining ourselves, we execute passed commands as-is by storing them, in temp file and passing to correct interpreter (bash or cmd) based on OS. Fixes #1065 ## Tests Added unit tests |
|
|
shreyas-goenka
|
55732bc6ac
|
Release v0.211.0 (#1083)
CLI: * Upgrade Go SDK to 0.27.0 ([#1064](https://github.com/databricks/cli/pull/1064)). * Skip profile resolution if `DATABRICKS_AUTH_TYPE` is set ([#1068](https://github.com/databricks/cli/pull/1068)). * Do not allow input prompts in Git Bash terminal ([#1069](https://github.com/databricks/cli/pull/1069)). * Added output template for list-secrets command ([#1074](https://github.com/databricks/cli/pull/1074)). Bundles: * Set metadata fields required to enable break-glass UI for jobs ([#880](https://github.com/databricks/cli/pull/880)). * Do not prompt for template values in Git Bash ([#1082](https://github.com/databricks/cli/pull/1082)). * Tune output of bundle deploy command ([#1047](https://github.com/databricks/cli/pull/1047)). API Changes: * Changed `databricks connections update` command with new required argument order. * Changed `databricks serving-endpoints update-config` command with new required argument order. * Added `databricks serving-endpoints put` command. * Removed `databricks account network-policy` command group. OpenAPI commit 63caa3cb0c05045e81d3dcf2451fa990d8670f36 (2023-12-12) Dependency updates: * Bump github.com/google/uuid from 1.4.0 to 1.5.0 ([#1073](https://github.com/databricks/cli/pull/1073)). * Bump golang.org/x/crypto from 0.16.0 to 0.17.0 ([#1076](https://github.com/databricks/cli/pull/1076)). |
|
|
Lennart Kats (databricks)
|
875c9d2db1
|
Tune output of bundle deploy command (#1047)
## Changes Update the output of the `deploy` command to be more concise and consistent: ``` $ databricks bundle deploy Building my_project... Uploading my_project-0.0.1+20231207.205106-py3-none-any.whl... Uploading bundle files to /Users/lennart.kats@databricks.com/.bundle/my_project/dev/files... Deploying resources... Updating deployment state... Deployment complete! ``` This does away with the intermediate success messages, makes consistent use of `...`, and only prints the success message at the very end after everything is completed. Below is the original output for comparison: ``` $ databricks bundle deploy Detecting Python wheel project... Found Python wheel project at /tmp/output/my_project Building my_project... Build succeeded Uploading my_project-0.0.1+20231207.205134-py3-none-any.whl... Upload succeeded Starting upload of bundle files Uploaded bundle files at /Users/lennart.kats@databricks.com/.bundle/my_project/dev/files! Starting resource deployment Resource deployment completed! ``` |
|
|
Andrew Nester
|
42f21d82fe
|
Do not prompt for template values in Git Bash (#1082)
## Changes Follow up on #1077 |
|
|
Andrew Nester
|
f18094d943
|
Revert using IsPromptSupported from promptOrAssignDefaultValues (#1077)
## Changes Fixes nightly test `TestAccBundleInitErrorOnUnknownFields`. `TestAccBundleInitErrorOnUnknownFields` has an interactive shell by default so the test fails on waiting for prompt. This was introduced in #1069. ## Tests Nightly test succeed. |
|
|
dependabot[bot]
|
5991e33ca7
|
Bump golang.org/x/crypto from 0.16.0 to 0.17.0 (#1076)
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.16.0 to 0.17.0. <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
shreyas-goenka
|
2d93f62f21
|
Set metadata fields required to enable break-glass UI for jobs (#880)
## Changes This PR sets the following fields for all jobs that are deployed from a DAB 1. `deployment`: This provides the platform with the path to a file to read the metadata from. 2. `edit_mode`: This tells the platform to display the break-glass UI for jobs deployed from a DAB. Setting this is required to re-lock the UI after a user clicks "disconnect from source". 3. `format = MULTI_TASK`. This makes the Terraform provider always use jobs API 2.1 for creating/updating the job. Required because `deployment` and `edit_mode` are only available in API 2.1. ## Tests Unit test and manually. Manually verified that deployments trigger the break glass UI. Manually verified there is no Terraform drift when all three fields are set. --------- Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com> |
|
|
Andrew Nester
|
5526cd3fb2
|
Added output template for list-secrets command (#1074)
## Changes Fixes #1067 ## Tests ``` andrew.nester@HFW9Y94129 cli % databricks secrets list-secrets "my-test-scope" --output text Key Last Updated Timestamp my-secret 1692805686489 my-test-secret 1692767910771 ``` |
|
|
Andrew Nester
|
6dd6899b52
|
Do not allow input prompts in Git Bash terminal (#1069)
## Changes Likely due to fact that Git Bash does not correctly support ANSI escape sequences, we cannot use `promptui` package there. See known issues: - https://github.com/manifoldco/promptui/issues/208 - https://github.com/chzyer/readline/issues/191 |
|
|
dependabot[bot]
|
4765493f18
|
Bump github.com/google/uuid from 1.4.0 to 1.5.0 (#1073)
Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.4.0 to 1.5.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/google/uuid/releases">github.com/google/uuid's releases</a>.</em></p> <blockquote> <h2>v1.5.0</h2> <h2><a href="https://github.com/google/uuid/compare/v1.4.0...v1.5.0">1.5.0</a> (2023-12-12)</h2> <h3>Features</h3> <ul> <li>Validate UUID without creating new UUID (<a href="https://redirect.github.com/google/uuid/issues/141">#141</a>) (<a href=" |
|
|
Pieter Noordhuis
|
cee70a53c8
|
Test existing behavior when loading non-string spark conf values (#1071)
## Changes This test is expected to fail when we enable the custom YAML loader. |
|
|
Pieter Noordhuis
|
b17e845d44
|
Skip profile resolution if `DATABRICKS_AUTH_TYPE` is set (#1068)
## Changes If a user configures a workspace host in a bundle and wants to use the "azure-cli" authentication type, we would still run profile resolution. If the databrickscfg has a matching profile, we still load it, even though it should be a fallback. ## Tests * Unit test. * Manually confirmed that setting `DATABRICKS_AUTH_TYPE=azure-cli` now works as expected. |
|
|
Andrew Nester
|
a6ec9ac08b
|
Upgrade Go SDK to 0.27.0 (#1064)
## Changes Upgrade Go SDK to 0.27.0 |
|
|
Andrew Nester
|
dc12b3f1cf
|
Release v0.210.3 (#1062)
Bundles: * Improve default template ([#1046](https://github.com/databricks/cli/pull/1046)). * Fix passthrough of pipeline notifications ([#1058](https://github.com/databricks/cli/pull/1058)). Internal: * Stub out Python virtual environment installation for `labs` commands ([#1057](https://github.com/databricks/cli/pull/1057)). * Upgrade Terraform schema version to v1.31.1 ([#1055](https://github.com/databricks/cli/pull/1055)). Dependency updates: * Bump github.com/hashicorp/hc-install from 0.6.1 to 0.6.2 ([#1054](https://github.com/databricks/cli/pull/1054)). * Bump github.com/databricks/databricks-sdk-go from 0.26.1 to 0.26.2 ([#1053](https://github.com/databricks/cli/pull/1053)). |
|
|
dependabot[bot]
|
8ac47d0b1d
|
Bump github.com/databricks/databricks-sdk-go from 0.26.1 to 0.26.2 (#1053)
Bumps [github.com/databricks/databricks-sdk-go](https://github.com/databricks/databricks-sdk-go) from 0.26.1 to 0.26.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/databricks/databricks-sdk-go/releases">github.com/databricks/databricks-sdk-go's releases</a>.</em></p> <blockquote> <h2>v0.26.2</h2> <p>This is a bugfix release, including a fix correcting issues with OAuth flows, due to a bug with the propagation of the response status in <code>httpclient</code>'s <code>RoundTrip()</code> implementation. This fixes the <code>failed during request visitor: token: oauth2: cannot fetch token: Response: {...}</code> error.</p> <p>All fixes:</p> <ul> <li>Migrate Azure MSI & Metadata Service token sources to <code>httpclient</code> and add 100% test coverage (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/709">#709</a>).</li> <li>Added <code>config.NewAzureCliTokenSource</code> and <code>config.NewAzureMsiTokenSource</code> constructors (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/727">#727</a>).</li> <li>Use per-config refresh context for OAuth tokens (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/728">#728</a>).</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/databricks/databricks-sdk-go/blob/main/CHANGELOG.md">github.com/databricks/databricks-sdk-go's changelog</a>.</em></p> <blockquote> <h2>0.26.2</h2> <p>This is a bugfix release, including a fix correcting issues with OAuth flows, due to a bug with the propagation of the response status in <code>httpclient</code>'s <code>RoundTrip()</code> implementation. This fixes the <code>failed during request visitor: token: oauth2: cannot fetch token: Response: {...}</code> error.</p> <p>All fixes:</p> <ul> <li>Migrate Azure MSI & Metadata Service token sources to <code>httpclient</code> and add 100% test coverage (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/709">#709</a>).</li> <li>Added <code>config.NewAzureCliTokenSource</code> and <code>config.NewAzureMsiTokenSource</code> constructors (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/727">#727</a>).</li> <li>Use per-config refresh context for OAuth tokens (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/728">#728</a>).</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
dependabot[bot]
|
e6bc4c9876
|
Bump github.com/hashicorp/hc-install from 0.6.1 to 0.6.2 (#1054)
Bumps [github.com/hashicorp/hc-install](https://github.com/hashicorp/hc-install) from 0.6.1 to 0.6.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/hashicorp/hc-install/releases">github.com/hashicorp/hc-install's releases</a>.</em></p> <blockquote> <h2>v0.6.2</h2> <h2>What's Changed</h2> <ul> <li>build(deps): bump actions/checkout from 4.1.0 to 4.1.1 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/162">hashicorp/hc-install#162</a></li> <li>build(deps): bump github.com/go-git/go-git/v5 from 5.10.0 to 5.10.1 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/168">hashicorp/hc-install#168</a></li> <li>build(deps): bump github.com/go-git/go-git/v5 from 5.9.0 to 5.10.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/163">hashicorp/hc-install#163</a></li> <li>build(deps): bump github.com/google/go-cmp from 0.5.9 to 0.6.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/160">hashicorp/hc-install#160</a></li> <li>build(deps): bump golang.org/x/mod from 0.13.0 to 0.14.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/165">hashicorp/hc-install#165</a></li> <li>build(deps): bump golang.org/x/net from 0.15.0 to 0.17.0 by <a href="https://github.com/dependabot"><code>@dependabot</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/161">hashicorp/hc-install#161</a></li> <li>build(deps): Bump workflows to latest trusted versions by <a href="https://github.com/hashicorp-tsccr"><code>@hashicorp-tsccr</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/167">hashicorp/hc-install#167</a></li> <li>ci: Automate releasing via bob by <a href="https://github.com/radeksimko"><code>@radeksimko</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/99">hashicorp/hc-install#99</a></li> <li>github: Replace dependabot with internal tooling by <a href="https://github.com/radeksimko"><code>@radeksimko</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/166">hashicorp/hc-install#166</a></li> <li>go: bump version to 1.21.3 by <a href="https://github.com/radeksimko"><code>@radeksimko</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/164">hashicorp/hc-install#164</a></li> <li>go: bump version to 1.21.4 by <a href="https://github.com/radeksimko"><code>@radeksimko</code></a> in <a href="https://redirect.github.com/hashicorp/hc-install/pull/169">hashicorp/hc-install#169</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a href="https://github.com/hashicorp-tsccr"><code>@hashicorp-tsccr</code></a> made their first contribution in <a href="https://redirect.github.com/hashicorp/hc-install/pull/167">hashicorp/hc-install#167</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/hashicorp/hc-install/compare/v0.6.1...v0.6.2">https://github.com/hashicorp/hc-install/compare/v0.6.1...v0.6.2</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |
|
|
Pieter Noordhuis
|
37671d9f54
|
Fix passthrough of pipeline notifications (#1058)
## Changes Notifications weren't passed along because of a plural vs singular mismatch. ## Tests * Added unit test coverage. * Manually confirmed it now works in an example bundle. |
|
|
shreyas-goenka
|
b479a7cf67
|
Upgrade Terraform schema version to v1.31.1 (#1055)
Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com> |
|
|
Lennart Kats (databricks)
|
8b9930a49a
|
Improve default template (#1046)
## Changes - Tweak strings, documentation in template - Extend requirements-dev.txt with setuptools/wheel for building whl files - Clarify what the "_job.yml" file is for for users who are only interested in DLT pipelines (answering a question that came up recently) ## Tests Existing tests exercise this template |
|
Serge Smertin
|
42c06267eb
|
Stub out Python virtual environment installation for `labs` commands (#1057)
This PR removes 15 seconds from `make test` runtime |
|
|
Andrew Nester
|
2d829678a0
|
Release v0.210.2 (#1044)
CLI: * Add documentation for positional args in commands generated from the Databricks OpenAPI specification ([#1033](https://github.com/databricks/cli/pull/1033)). * Ask for host when .databrickscfg doesn't exist ([#1041](https://github.com/databricks/cli/pull/1041)). * Add list of supported values for flags that represent an enum field ([#1036](https://github.com/databricks/cli/pull/1036)). Bundles: * Fix panic when bundle auth resolution fails ([#1002](https://github.com/databricks/cli/pull/1002)). * Add versioning for bundle templates ([#972](https://github.com/databricks/cli/pull/972)). * Add support for conditional prompting in bundle init ([#971](https://github.com/databricks/cli/pull/971)). * Pass parameters to task when run with `--python-params` and `python_wheel_wrapper` is true ([#1037](https://github.com/databricks/cli/pull/1037)). * Change default_python template to auto-update version on each wheel build ([#1034](https://github.com/databricks/cli/pull/1034)). Internal: * Rewrite the friendly log handler ([#1038](https://github.com/databricks/cli/pull/1038)). * Move bundle schema update to an internal module ([#1012](https://github.com/databricks/cli/pull/1012)). Dependency updates: * Bump github.com/databricks/databricks-sdk-go from 0.26.0 to 0.26.1 ([#1040](https://github.com/databricks/cli/pull/1040)). |
|
|
shreyas-goenka
|
6002f49c87
|
Move bundle schema update to an internal module (#1012)
## Changes This PR: 1. Move code to load bundle JSON Schema descriptions from the OpenAPI spec to an internal Go module 2. Remove command line flags from the `bundle schema` command. These flags were meant for internal processes and at no point were meant for customer use. 3. Regenerate `bundle_descriptions.json` 4. Add support for `bundle: "deprecated"`. The `environments` field is tagged as deprecated in this PR and consequently will no longer be a part of the bundle schema. ## Tests Tested by regenerating the CLI against its current OpenAPI spec (as defined in `__openapi_sha`). The `bundle_descriptions.json` in this PR was generated from the code generator. Manually checked that the autocompletion / descriptions from the new bundle schema are correct. |
|
|
shreyas-goenka
|
a6752a5388
|
Add list of supported values for flags that represent an enum field (#1036)
## Changes This PR adds the list of supported values for flags that represent an enum field in the flag's documentation. |
|
|
dependabot[bot]
|
e9ed828119
|
Bump github.com/databricks/databricks-sdk-go from 0.26.0 to 0.26.1 (#1040)
Bumps [github.com/databricks/databricks-sdk-go](https://github.com/databricks/databricks-sdk-go) from 0.26.0 to 0.26.1. <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/databricks/databricks-sdk-go/blob/main/CHANGELOG.md">github.com/databricks/databricks-sdk-go's changelog</a>.</em></p> <blockquote> <h2>0.26.1</h2> <p>Minor changes:</p> <ul> <li>Support overriding DatabricksEnvironment (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/723">#723</a>).</li> <li>Detect <code>Accept</code> header in <code>httpclient.WithResponseUnmarshal</code> (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/710">#710</a>).</li> <li>Detect <code>Content-Type</code> header in <code>newRequestBody</code> for <code>httpclient</code> (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/711">#711</a>).</li> </ul> <p>Bug fixes:</p> <ul> <li>Retry request on <code>REQUEST_LIMIT_EXCEEDED</code> error returned by the SCIM API (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/721">#721</a>).</li> <li>Match retry logic of pre-refactor SDK (<a href="https://redirect.github.com/databricks/databricks-sdk-go/pull/722">#722</a>).</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href=" |