Shreyas Goenka
e55df7b207
Merge remote-tracking branch 'origin' into improve/json-schema
2024-09-05 14:16:14 +02:00
Shreyas Goenka
4379d7f09b
allow artifacts referencing
2024-09-05 14:15:35 +02:00
Shreyas Goenka
d0aa493281
-
2024-09-05 14:15:08 +02:00
Pieter Noordhuis
ceefa80d72
Pass copy of `dyn.Path` to callback function ( #1747 )
...
## Changes
Some call sites hold on to the `dyn.Path` provided to them by the
callback. It must therefore never be mutated after the callback returns,
or these mutations leak out into unknown scope.
This change means it is no longer possible for this failure mode to
happen.
## Tests
Unit test.
2024-09-05 11:05:16 +00:00
Andrew Nester
f71d9e7649
[Release] Release v0.228.0 ( #1752 )
...
CLI:
* Do not error if we cannot prompt for a profile in `auth login`
([#1745 ](https://github.com/databricks/cli/pull/1745 )).
Bundles:
As of this release CLI will show a prompt is if there are configuration
changes which will lead to a DLT recreation.
Users can skip the prompt by specifying the `--auto-approve` flag
* Pass along $AZURE_CONFIG_FILE to Terraform process
([#1734 ](https://github.com/databricks/cli/pull/1734 )).
* Add prompt when a pipeline recreation happens
([#1672 ](https://github.com/databricks/cli/pull/1672 )).
* Use materialized views in the default-sql template
([#1709 ](https://github.com/databricks/cli/pull/1709 )).
* Update templates to latest LTS DBR
([#1715 ](https://github.com/databricks/cli/pull/1715 )).
* Make lock optional in the JSON schema
([#1738 ](https://github.com/databricks/cli/pull/1738 )).
* Do not suppress normalisation diagnostics for resolving variables
([#1740 ](https://github.com/databricks/cli/pull/1740 )).
* Include a permissions section in all templates
([#1713 ](https://github.com/databricks/cli/pull/1713 )).
* Fixed complex variables are not being correctly merged from include
files ([#1746 ](https://github.com/databricks/cli/pull/1746 )).
* Fixed variable override in target with full variable syntax
([#1749 ](https://github.com/databricks/cli/pull/1749 )).
Internal:
* Consider serverless clusters as compatible for Python wheel tasks
([#1733 ](https://github.com/databricks/cli/pull/1733 )).
* PythonMutator: explain missing package error
([#1736 ](https://github.com/databricks/cli/pull/1736 )).
* Add `dyn.Time` to box a timestamp with its original string value
([#1732 ](https://github.com/databricks/cli/pull/1732 )).
* Fix streaming of stdout, stdin, stderr in cobra test runner
([#1742 ](https://github.com/databricks/cli/pull/1742 )).
Dependency updates:
* Bump github.com/Masterminds/semver/v3 from 3.2.1 to 3.3.0
([#1741 ](https://github.com/databricks/cli/pull/1741 )).
---------
Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
2024-09-05 08:56:52 +00:00
Andrew Nester
72030844c5
Fixed variable override in target with full variable syntax ( #1749 )
...
## Changes
This PR makes sure that both of this override syntax for variables work
correctly
```
targets:
dev:
variables:
cluster1:
spark_version: "14.2.x-scala2.11"
node_type_id: "Standard_DS3_v2"
num_workers: 4
spark_conf:
spark.speculation: false
spark.databricks.delta.retentionDurationCheck.enabled: false
cluster2:
default:
spark_version: "14.2.x-scala2.11"
node_type_id: "Standard_DS3_v2"
num_workers: 4
spark_conf:
spark.speculation: false
spark.databricks.delta.retentionDurationCheck.enabled: false
```
## Tests
Added regression test
---------
Co-authored-by: Pieter Noordhuis <pieter.noordhuis@databricks.com>
2024-09-04 17:16:40 +00:00
Shreyas Goenka
42da1c97ba
Merge remote-tracking branch 'origin' into improve/json-schema
2024-09-04 13:41:43 +02:00
Andrew Nester
ca6332a5a4
Fixed complex variables are not being correctly merged from include files ( #1746 )
...
## Changes
Fixes an `Error: no value assigned to required variable <variable>.`
when the main complex variable definition is defined in one file but
target override is defined in separate file which is included in the
main one.
## Tests
Added regression test
2024-09-04 11:24:55 +00:00
shreyas-goenka
a27c24a397
Add prompt when a pipeline recreation happens ( #1672 )
...
## Changes
DLT pipeline recreations are destructive. They can lead to lost history
of previous updates, outage of the tables temporarily and are
potentially computationally expensive. Thus we make a breaking change
where a prompt is shown to the user if there configuration changes will
lead to a DLT recreation.
Users can skip the prompt by specifying the `--auto-approve` flag.
This PR also fixes an issue with our test runner where logs from the
cmdio.Logger would not get propagated to the reader returned by our
cobra test runner.
## Tests
Manually, and new unit and integration tests.
```
➜ bundle-playground-3 cli bundle deploy
Uploading bundle files to /Users/63ec021d-b0c6-49c0-93a0-5123953a1cb2/.bundle/test/development/files...
The following DLT pipelines will be recreated. Underlying tables will be unavailable for a transient period until the newly recreated pipelines are run once successfully. History of previous pipeline update runs will be lost because of recreation:
recreate pipeline foo
Would you like to proceed? [y/n]: n
Deployment cancelled!
```
2024-09-04 11:11:47 +00:00
Shreyas Goenka
a64857ed4c
-
2024-09-04 11:58:02 +02:00
Shreyas Goenka
bfe9cc4d50
create generated package
2024-09-04 11:56:52 +02:00
Shreyas Goenka
446463b9eb
update schema
2024-09-04 11:33:28 +02:00
Shreyas Goenka
9d9c6120a1
Merge remote-tracking branch 'origin' into improve/json-schema
2024-09-04 11:32:49 +02:00
Shreyas Goenka
ba3f004da1
schema local to generator
2024-09-04 11:32:39 +02:00
Shreyas Goenka
66cbb548ef
return typPath from walk
2024-09-04 11:28:53 +02:00
Shreyas Goenka
6bd7ad0fb2
clarify interface comments
2024-09-04 11:15:00 +02:00
Shreyas Goenka
46585bbd3f
type defs as map[string]any
2024-09-04 11:03:33 +02:00
Shreyas Goenka
8575c47626
json pointer comment
2024-09-04 11:00:53 +02:00
Shreyas Goenka
be0ad482ff
str bool
2024-09-04 10:43:46 +02:00
Shreyas Goenka
3d5c076a4d
jsonTags[0] -> fieldName
2024-09-04 10:40:04 +02:00
Shreyas Goenka
176ced190e
add tests for bfs assertion
2024-09-04 10:26:47 +02:00
shreyas-goenka
35cdf4010d
Do not error if we cannot prompt for a profile in `auth login` ( #1745 )
...
## Changes
With https://github.com/databricks/cli/pull/1370 we started to error if
a profile name was not provided in a non-tty setting. The Databricks
VSCode extension, however, uses the `auth login` command to simply
refresh the tokens. Thus, this PR is a regression fix for that use case.
## Tests
Manually, `databricks auth login --host
https://e2-dogfood.staging.cloud.databricks.com ` no longer errors.
Instead it successfully refreshes the credentials.
2024-09-04 07:14:21 +00:00
Shreyas Goenka
578019ba22
-
2024-09-03 20:14:02 +02:00
Lennart Kats (databricks)
072fa812e2
Include a permissions section in all templates ( #1713 )
...
## Changes
This updates the templates to include a `permissions` section. Having a
permissions section is a best practice, is helpful to understand the
notion of permissions, and helps diagnose permission errors
(https://github.com/databricks/cli/pull/1386 ).
This is a cherry-pick from https://github.com/databricks/cli/pull/1387 .
This change was verified to work both in dev and prod. Existing unit
tests validate the validity of the templates in these modes.
2024-09-03 07:51:54 +00:00
shreyas-goenka
096123674a
Fix streaming of stdout, stdin, stderr in cobra test runner ( #1742 )
...
## Changes
We were not using the readers and writers set in the test fixtures in
the progress logger. This PR fixes that. It also modifies
`TestAccAbortBind`, which was implicitly relying on the bug.
I encountered this bug while working on
https://github.com/databricks/cli/pull/1672 .
## Tests
Manually.
From non-tty:
```
Error: failed to bind the resource, err: This bind operation requires user confirmation, but the current console does not support prompting. Please specify --auto-approve if you would like to skip prompts and proceed.
```
From tty, bind works as expected.
```
Confirm import changes? Changes will be remotely applied only after running 'bundle deploy'. [y/n]: y
Updating deployment state...
Successfully bound databricks_pipeline with an id '9d2dedbb-f522-4503-96ba-4bc4d5bfa77d'. Run 'bundle deploy' to deploy changes to your workspace
```
2024-09-02 13:43:17 +00:00
dependabot[bot]
0ce7be8ff0
Bump github.com/Masterminds/semver/v3 from 3.2.1 to 3.3.0 ( #1741 )
...
Bumps
[github.com/Masterminds/semver/v3](https://github.com/Masterminds/semver )
from 3.2.1 to 3.3.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/Masterminds/semver/releases ">github.com/Masterminds/semver/v3's
releases</a>.</em></p>
<blockquote>
<h2>v3.3.0</h2>
<h2>What's Changed</h2>
<ul>
<li>Fix: bad package in README by <a
href="https://github.com/sdelicata "><code>@sdelicata</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/226 ">Masterminds/semver#226</a></li>
<li>Updating the GitHub Actions and versions of Go used by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/229 ">Masterminds/semver#229</a></li>
<li>Fix spelling in README by <a
href="https://github.com/robinschneider "><code>@robinschneider</code></a>
in <a
href="https://redirect.github.com/Masterminds/semver/pull/222 ">Masterminds/semver#222</a></li>
<li>Adding go build cache to fuzz output by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/232 ">Masterminds/semver#232</a></li>
<li>Add caching to fuzz testing by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/234 ">Masterminds/semver#234</a></li>
<li>updating github actions by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/235 ">Masterminds/semver#235</a></li>
<li>feat: nil version equality by <a
href="https://github.com/KnutZuidema "><code>@KnutZuidema</code></a> in
<a
href="https://redirect.github.com/Masterminds/semver/pull/213 ">Masterminds/semver#213</a></li>
<li>add >= and <= by <a
href="https://github.com/grosser "><code>@grosser</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/238 ">Masterminds/semver#238</a></li>
<li>doc: hyphen range constraint without whitespace by <a
href="https://github.com/johnnychen94 "><code>@johnnychen94</code></a>
in <a
href="https://redirect.github.com/Masterminds/semver/pull/216 ">Masterminds/semver#216</a></li>
<li>Removing reference to vert by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/245 ">Masterminds/semver#245</a></li>
<li>simplify StrictNewVersion by <a
href="https://github.com/grosser "><code>@grosser</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/241 ">Masterminds/semver#241</a></li>
<li>Updating the testing version of Go used by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/246 ">Masterminds/semver#246</a></li>
<li>bumping min version in go.mod based on what's tested by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/248 ">Masterminds/semver#248</a></li>
<li>Updating changelog for 3.3.0 by <a
href="https://github.com/mattfarina "><code>@mattfarina</code></a> in <a
href="https://redirect.github.com/Masterminds/semver/pull/249 ">Masterminds/semver#249</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/sdelicata "><code>@sdelicata</code></a>
made their first contribution in <a
href="https://redirect.github.com/Masterminds/semver/pull/226 ">Masterminds/semver#226</a></li>
<li><a
href="https://github.com/robinschneider "><code>@robinschneider</code></a>
made their first contribution in <a
href="https://redirect.github.com/Masterminds/semver/pull/222 ">Masterminds/semver#222</a></li>
<li><a
href="https://github.com/KnutZuidema "><code>@KnutZuidema</code></a>
made their first contribution in <a
href="https://redirect.github.com/Masterminds/semver/pull/213 ">Masterminds/semver#213</a></li>
<li><a href="https://github.com/grosser "><code>@grosser</code></a> made
their first contribution in <a
href="https://redirect.github.com/Masterminds/semver/pull/238 ">Masterminds/semver#238</a></li>
<li><a
href="https://github.com/johnnychen94 "><code>@johnnychen94</code></a>
made their first contribution in <a
href="https://redirect.github.com/Masterminds/semver/pull/216 ">Masterminds/semver#216</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a
href="https://github.com/Masterminds/semver/compare/v3.2.1...v3.3.0 ">https://github.com/Masterminds/semver/compare/v3.2.1...v3.3.0 </a></p>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/Masterminds/semver/blob/master/CHANGELOG.md ">github.com/Masterminds/semver/v3's
changelog</a>.</em></p>
<blockquote>
<h2>3.3.0 (2024-08-27)</h2>
<h3>Added</h3>
<ul>
<li><a
href="https://redirect.github.com/Masterminds/semver/issues/238 ">#238</a>:
Add LessThanEqual and GreaterThanEqual functions (thanks <a
href="https://github.com/grosser "><code>@grosser</code></a>)</li>
<li><a
href="https://redirect.github.com/Masterminds/semver/issues/213 ">#213</a>:
nil version equality checking (thanks <a
href="https://github.com/KnutZuidema "><code>@KnutZuidema</code></a>)</li>
</ul>
<h3>Changed</h3>
<ul>
<li><a
href="https://redirect.github.com/Masterminds/semver/issues/241 ">#241</a>:
Simplify StrictNewVersion parsing (thanks <a
href="https://github.com/grosser "><code>@grosser</code></a>)</li>
<li>Testing support up through Go 1.23</li>
<li>Minimum version set to 1.21 as this is what's tested now</li>
<li>Fuzz testing now supports caching</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="e6e3d4d3cb
"><code>e6e3d4d</code></a>
Merge pull request <a
href="https://redirect.github.com/Masterminds/semver/issues/249 ">#249</a>
from mattfarina/update-changelog-3.3.0</li>
<li><a
href="e80c4ea723
"><code>e80c4ea</code></a>
Updating changelog for 3.3.0</li>
<li><a
href="80427ad56e
"><code>80427ad</code></a>
Merge pull request <a
href="https://redirect.github.com/Masterminds/semver/issues/248 ">#248</a>
from mattfarina/bump-min-version</li>
<li><a
href="b610837227
"><code>b610837</code></a>
bumping min version in go.mod based on what's tested</li>
<li><a
href="a4cccd8ea5
"><code>a4cccd8</code></a>
Merge pull request <a
href="https://redirect.github.com/Masterminds/semver/issues/246 ">#246</a>
from mattfarina/bump-go-1.23</li>
<li><a
href="7c178cf0c6
"><code>7c178cf</code></a>
Updating the testing version of Go used</li>
<li><a
href="29f94c1119
"><code>29f94c1</code></a>
Merge pull request <a
href="https://redirect.github.com/Masterminds/semver/issues/241 ">#241</a>
from grosser/grosser/validate</li>
<li><a
href="2cf1b16b95
"><code>2cf1b16</code></a>
Merge pull request <a
href="https://redirect.github.com/Masterminds/semver/issues/245 ">#245</a>
from mattfarina/remove-vert</li>
<li><a
href="b55476af0e
"><code>b55476a</code></a>
Removing reference to vert</li>
<li><a
href="d07450b7cf
"><code>d07450b</code></a>
simplify StrictNewVersion</li>
<li>Additional commits viewable in <a
href="https://github.com/Masterminds/semver/compare/v3.2.1...v3.3.0 ">compare
view</a></li>
</ul>
</details>
<br />
[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com/Masterminds/semver/v3&package-manager=go_modules&previous-version=3.2.1&new-version=3.3.0 )](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores )
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
</details>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-02 12:39:16 +00:00
Gleb Kanterov
ed448815b4
PythonMutator: explain missing package error ( #1736 )
...
## Changes
Explain the error when the `databricks-pydabs` package is not installed
or the Python environment isn't correctly activated.
Example output:
```
Error: python mutator process failed: ".venv/bin/python3 -m databricks.bundles.build --phase load --input .../input.json --output .../output.json --diagnostics .../diagnostics.json: exit status 1", use --debug to enable logging
.../.venv/bin/python3: Error while finding module specification for 'databricks.bundles.build' (ModuleNotFoundError: No module named 'databricks')
Explanation: 'databricks-pydabs' library is not installed in the Python environment.
If using Python wheels, ensure that 'databricks-pydabs' is included in the dependencies,
and that the wheel is installed in the Python environment:
$ .venv/bin/pip install -e .
If using a virtual environment, ensure it is specified as the venv_path property in databricks.yml,
or activate the environment before running CLI commands:
experimental:
pydabs:
venv_path: .venv
```
## Tests
Unit tests
2024-09-02 09:49:30 +00:00
Andrew Nester
582558cac2
Do not suppress normalisation diagnostics for resolving variables ( #1740 )
...
## Changes
Tested on the following bundle configuration
```
bundle:
name: clusters
mode: development
variables:
webhook_notifications:
description: Webhook URL for notifications
type: complex
default:
on_failure:
id: 6a6c04c1-389c-4534-95af-b68b62a9dbe6
resources:
jobs:
test_job:
name: "Andrew Nester Test Job"
tasks:
- task_key: test_task
notebook_task:
notebook_path: "./src/test.py"
new_cluster:
num_workers: 2
node_type_id: "i3.xlarge"
autoscale:
min_workers: 2
max_workers: 7
spark_version: "12.2.x-scala2.12"
spark_conf:
"spark.executor.memory": "2g"
webhook_notifications: ${var.webhook_notifications}
```
bundle validate output is below
```
andrew.nester@HFW9Y94129 wheel % databricks bundle validate
Warning: expected sequence, found map
at resources.jobs.test_job.webhook_notifications.on_failure
in bundle.yml:11:9
Name: clusters
Target: default
Workspace:
User: andrew.nester@databricks.com
Path: /Users/andrew.nester@databricks.com/.bundle/clusters/default
```
**Note** that error correctly points to the variable
2024-09-02 09:17:18 +00:00
shreyas-goenka
5d9910c8e0
Make lock optional in the JSON schema ( #1738 )
...
Fixes https://github.com/databricks/cli/issues/1561
2024-09-02 08:39:08 +00:00
Gleb Kanterov
70ce802518
PythonMutator: preserve normalize diagnostics ( #1735 )
...
## Changes
Preserve diagnostics if there are any errors or warnings when
PythonMutator normalizes output. If anything goes wrong during
conversion, diagnostics contain the relevant location and path.
## Tests
Unit tests
2024-08-30 13:29:00 +00:00
Lennart Kats (databricks)
ed4a4585c0
Update templates to latest LTS DBR ( #1715 )
...
## Changes
This updates the templates to use the latest DBR 15 LTS version.
- [x] DB Connect 15.4 must be released + validated before this can go
out
2024-08-30 07:32:10 +00:00
Lennart Kats (databricks)
2e000f1ebd
Use materialized views in the default-sql template ( #1709 )
...
## Changes
Materialized views now support `CREATE OR REPLACE`
([docs](https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-ddl-create-materialized-view.html ))!
This makes it possible to use them with Workflows in DABs.This PR
updates the template to use a materialized view rather than a regular
view.
## Tests
Manually validated in production.
2024-08-29 19:07:21 +00:00
Pieter Noordhuis
5fac7edcdf
Pass along $AZURE_CONFIG_FILE to Terraform process ( #1734 )
...
## Changes
This ensures that the CLI and Terraform can both use an Azure CLI
session configured under a non-standard path. This is the default
behavior on Azure DevOps when using the AzureCLI@2 task.
Fixes #1722 .
## Tests
Unit test.
2024-08-29 14:41:12 +00:00
Pieter Noordhuis
0f4891f0fe
Add `dyn.Time` to box a timestamp with its original string value ( #1732 )
...
## Changes
If not explicitly quoted, the YAML loader interprets a value like
`2024-08-29` as a timestamp. Such a value is usually intended to be a
string instead. Our normalization logic was not able to turn a time
value back into the original string.
This change boxes the time value to include its original string
representation. Normalization of one of these values into a string can
now use the original input value.
## Tests
Unit tests in `libs/dyn/convert`.
2024-08-29 13:02:34 +00:00
Andrew Nester
43ace69bb9
Consider serverless clusters as compatible for Python wheel tasks ( #1733 )
...
## Changes
Consider serverless clusters as compatible for Python wheel tasks.
Fixes a `Python wheel tasks require compute with DBR 13.3+ to include
local libraries` warning shown for serverless clusters
2024-08-29 12:47:44 +00:00
Andrew Nester
7dcc791b05
[Release] Release v0.227.1 ( #1729 )
...
CLI:
* Disable prompt for storage-credentials get command
([#1723 ](https://github.com/databricks/cli/pull/1723 )).
Bundles:
* Do not treat empty path as a local path
([#1717 ](https://github.com/databricks/cli/pull/1717 )).
* Correctly mark PyPI package name specs with multiple specifiers as
remote libraries ([#1725 ](https://github.com/databricks/cli/pull/1725 )).
* Improve error handling for /Volumes paths in mode: development
([#1716 ](https://github.com/databricks/cli/pull/1716 )).
Internal:
* Ignore CLI version check on development builds of the CLI
([#1714 ](https://github.com/databricks/cli/pull/1714 )).
API Changes:
* Added `databricks resource-quotas` command group.
* Added `databricks policy-compliance-for-clusters` command group.
* Added `databricks policy-compliance-for-jobs` command group.
OpenAPI commit 3eae49b444cac5a0118a3503e5b7ecef7f96527a (2024-08-21)
Dependency updates:
* Bump github.com/databricks/databricks-sdk-go from 0.44.0 to 0.45.0
([#1719 ](https://github.com/databricks/cli/pull/1719 )).
* Revert hc-install version to 0.7.0
([#1711 ](https://github.com/databricks/cli/pull/1711 )).
2024-08-28 13:09:07 +00:00
Lennart Kats (databricks)
85459c1963
Improve error handling for /Volumes paths in mode: development ( #1716 )
...
## Changes
* Provide a more helpful error when using an artifact_path based on
/Volumes
* Allow the use of short_names in /Volumes paths
## Example cases
Example of a valid /Volumes artifact_path:
* `artifact_path:
/Volumes/catalog/schema/${workspace.current_user.short_name}/libs`
Example of an invalid /Volumes path (when using `mode: development`):
* `artifact_path: /Volumes/catalog/schema/libs`
* Resulting error: `artifact_path should contain the current username or
${workspace.current_user.short_name} to ensure uniqueness when using
'mode: development'`
2024-08-28 12:14:19 +00:00
Andrew Nester
70363836d5
Correctly mark PyPI package name specs with multiple specifiers as remote libraries ( #1725 )
...
Correctly mark pypi package name specs with multiple specifiers as
remote libraries
Fixes this https://github.com/databricks/cli/issues/1728
2024-08-28 11:39:06 +00:00
Shreyas Goenka
cb8d6a9f60
self pass 1
2024-08-27 19:50:43 +02:00
Shreyas Goenka
4141f4ea34
-
2024-08-27 17:49:09 +02:00
Shreyas Goenka
aac6687900
remove more todos
2024-08-27 17:46:57 +02:00
Shreyas Goenka
40f4d35c4a
cleanup todos
2024-08-27 17:45:20 +02:00
Shreyas Goenka
ad7503a176
cleanup todos
2024-08-27 17:40:36 +02:00
Shreyas Goenka
f194a5b86a
skip adding patterns for string schemas
2024-08-27 17:36:12 +02:00
Andrew Nester
edc08149d3
Disable prompt for storage-credentials get command ( #1723 )
...
## Changes
Fixes #1079
2024-08-27 12:51:10 +00:00
Shreyas Goenka
acc43092ad
fix lint
2024-08-27 14:17:04 +02:00
Shreyas Goenka
727036bb40
bundle schema command is OK now
2024-08-27 13:46:52 +02:00
Shreyas Goenka
483480f4a9
-
2024-08-27 13:39:23 +02:00
Shreyas Goenka
2c30cfa5a2
-
2024-08-27 13:38:42 +02:00
Shreyas Goenka
ac60163c19
move gen file
2024-08-27 13:35:56 +02:00