steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,839 Commits 133 Branches 115 Tags 151 MiB
Commit Graph

1839 Commits

Author SHA1 Message Date
Denis Bilenko 0b083e9ffe Install last wheel with regular 'pip' 2025-03-05 17:21:41 +01:00
Denis Bilenko ca0f3a13eb replace findFiles with findFile 2025-03-05 17:03:30 +01:00
Denis Bilenko 482bf34ff4 update comment 2025-03-05 16:20:20 +01:00
Denis Bilenko 97dedaba7f update comments 2025-03-05 16:14:09 +01:00
Denis Bilenko 9568ce19ac
Merge branch 'main' into denik/wheel-patch 2025-03-05 16:08:20 +01:00
Denis Bilenko 7488b5ce98 update acceptance test 2025-03-05 16:02:02 +01:00
Denis Bilenko (aider) 60812fc5d7 feat: Interpret timestamp as UTC in setmtime.py script 2025-03-05 15:58:58 +01:00
Denis Bilenko f1a22fc486 use UnixNano() for time 2025-03-05 15:49:15 +01:00
Denis Bilenko 106ce9438e do not add extra newline in RECORD 2025-03-05 15:36:39 +01:00
Denis Bilenko 63e6d623c0 show diff between original and new 2025-03-05 15:34:24 +01:00
Denis Bilenko f2b5dd97a6 update ruff exclude 2025-03-05 15:29:25 +01:00
Denis Bilenko bde1181644 add missing setmtime.py 2025-03-05 15:22:18 +01:00
shreyas-goenka a24a7f5738
Remove omitempty tag for exit code and execution time in telemetry (#2433) 2025-03-05 14:20:59 +00:00
Pieter Noordhuis 6ae353d84b
Use schema field for pipeline in builtin template (#2347) 
## Changes

The `schema` field implies the lifecycle of tables is no longer tied to
the lifecycle of the pipeline, as was the case with the `target` field.

More information about using the "catalog" and "schema" properties can
be found here:
https://docs.databricks.com/en/delta-live-tables/target-schema.html

## Tests

n/a

---------

Co-authored-by: Lennart Kats (databricks) <lennart.kats@databricks.com>
 2025-03-05 14:19:33 +00:00
Denis Bilenko edf361ce6c fix bug in Version: line; add "selftest patchwhl" command + acceptance test 2025-03-05 15:18:59 +01:00
Denis Bilenko (aider) 5c46e62374 feat: Implement fixed modification time and deterministic wheel filename in test 2025-03-05 14:52:23 +01:00
Denis Bilenko f681a9261f refactor: Update TODO comment with specific mtime for prebuilt wheel test 2025-03-05 14:52:20 +01:00
Denis Bilenko 34c2265965 test: Add TODO comment for prebuilt patch wheel test 2025-03-05 14:50:52 +01:00
Denis Bilenko (aider) e7af1a606d feat: Implement wheel METADATA and RECORD file verification in test 2025-03-05 14:47:42 +01:00
Denis Bilenko 130ed8b78b test: Add TODO comment for future METADATA and RECORD file verification 2025-03-05 14:47:40 +01:00
Denis Bilenko 9e62ba87a3 use Buffer in parseRecord 2025-03-05 14:44:10 +01:00
Russell Clarey 3a3076d9ea
Output deprecated annotations in the JSON schema (#2422) 
## Changes
Start outputting `deprecated` and `deprecationMessage` annotations in
the JSON schema

## Why
So that deprecated fields are shown as deprecated in VSCode (and other
editors)

## Tests
- manually tested

||||
|---|---|---|
|<img width="682" alt="Screenshot 2025-03-03 at 16 04 21"
src="https://github.com/user-attachments/assets/9712aa2f-0f41-48a9-8bd0-ec92b8b75c3f"
/>|<img width="682" alt="Screenshot 2025-03-03 at 16 04 29"
src="https://github.com/user-attachments/assets/a14f3523-ad85-4fed-96d7-2a8cf3a458e5"
/>|<img width="682" alt="Screenshot 2025-03-03 at 16 06 03"
src="https://github.com/user-attachments/assets/b9ab1050-048e-4c14-b183-96d615a4fbc1"
/>|
 2025-03-05 11:17:03 +00:00
Denis Bilenko a26461c5a3
Do not modify/create .gitignore in bundle root (#2429) 
## Changes
- Do not modify or edit .gitignore in bundle root.
- Instead create .databricks/.gitignore with content set to "*"

## Why
Merging our changes into existing .gitignore is complicated and adding
.gitignore where it's not expected adds to the noise. Other tools also
use the approach in this PR (e.g. ruff creates .ruff_cache/.gitignore).

## Tests
- Modified templates/default-sql to capture this new file.
 2025-03-05 10:57:05 +00:00
Denis Bilenko e73dafca83 use CutSuffix 2025-03-05 11:54:56 +01:00
Denis Bilenko 4a2485fcc9 add a comment to findFiles 2025-03-05 11:51:59 +01:00
Denis Bilenko d79e0db71b use cutSuffix; add link to pep 2025-03-05 11:50:09 +01:00
Denis Bilenko 04eed7a0d9 rm unnecessary replace; add a comment with example 2025-03-05 11:47:20 +01:00
Denis Bilenko 704bb5cb0e use strings.Cut 2025-03-05 11:45:51 +01:00
Denis Bilenko fe275654fb
Merge branch 'main' into denik/wheel-patch 2025-03-05 11:42:54 +01:00
Andrew Nester 4dba35dff4
Upgrade TF provider to 1.68.0 (#2426) 
## Changes
Upgrade TF provider to 1.68.0

- Added support for Volumes as a destination for Cluster log conf
 2025-03-05 10:20:55 +00:00
Andrew Nester 294db2ecca
Upgrade Go SDK to 0.59.0 (#2425) 
## Changes
- Added `service-principal-secrets` command
- Added `budget-policy-id` for apps
- `experiments.log-inputs` now requires `ID` parameter as an input
- Added `genie.get-space` command
- Added `providers.list-provider-share-assets` command

For the whole list of SDK changes see:
https://github.com/databricks/databricks-sdk-go/releases/tag/v0.59.0
 2025-03-05 10:20:51 +00:00
shreyas-goenka b21fdac209
Update VSCode settings to resolve files named `script` as shell scripts (#2419) 
## Why
VSCode for me resolves `script` as YAML files showing incorrect syntax
coloring. This setting forces VSCode to treat all files named `script`
as shell scripts leading to better syntax highlighting.

These files are common place in our acceptance tests.

## Tests
Manually.
 2025-03-05 10:02:40 +00:00
Denis Bilenko 75b169fa71 CalculateNewVersion -> calculateNewVersion 2025-03-05 10:51:56 +01:00
Denis Bilenko 97f87d2544 rm -short support; not a big win with parallel runs 2025-03-05 10:45:45 +01:00
Denis Bilenko d7daebfba0 replace findMetadataAndRecord with more general findFiles 2025-03-05 10:44:32 +01:00
Denis Bilenko 1fbb81eb87
Disable ruff cache (#2430) 
There is no perf difference, it's fast in both cases:

```
~/work/cli % hyperfine 'ruff format -qn'
Benchmark 1: ruff format -qn
  Time (mean ± σ):      22.5 ms ±   4.1 ms    [User: 23.6 ms, System: 106.7 ms]
  Range (min … max):    17.3 ms …  50.2 ms    52 runs
```

but it no longer produces .ruff_cache which can confuse acceptance test
runner

```
~/work/cli % find . -type d | grep ruff
./.ruff_cache
./.ruff_cache/0.8.3
./libs/notebook/testdata/.ruff_cache
./libs/notebook/testdata/.ruff_cache/0.8.3
./libs/sync/testdata/.ruff_cache
./libs/sync/testdata/.ruff_cache/0.8.3
./acceptance/bundle/templates/default-sql/.ruff_cache
./acceptance/bundle/templates/default-sql/.ruff_cache/0.8.3
```
 2025-03-05 08:45:51 +01:00
Denis Bilenko b9eeecd5a1 add a log 2025-03-04 18:27:45 +01:00
Denis Bilenko ca55524f94 remove glob matching in readMetadataAndRecord, rename to findMetadataAndRecord 2025-03-04 18:17:17 +01:00
Denis Bilenko 138ced54eb use full struct, not pointer 2025-03-04 18:07:01 +01:00
Denis Bilenko 5abb022506 clean up and simplify parsing 2025-03-04 18:02:57 +01:00
Denis Bilenko (aider) 653ca59edf (no commit message provided) 2025-03-04 18:02:57 +01:00
Denis Bilenko (aider) b0348de83b fix: Correctly parse wheel filename version without build tag 2025-03-04 18:02:57 +01:00
Denis Bilenko (aider) 5a60b73ad8 fix: Correctly parse wheel filename with build tags 2025-03-04 18:02:57 +01:00
Denis Bilenko (aider) 3135f4e38f feat: Add comprehensive test cases for wheel filename parsing 2025-03-04 18:02:57 +01:00
Denis Bilenko 95a64fd3cb docs: Add comprehensive wheel filename parsing test cases as comment 2025-03-04 18:02:57 +01:00
Denis Bilenko a100671b8b
Merge branch 'main' into denik/wheel-patch 2025-03-04 16:21:02 +01:00
Denis Bilenko cc59dec5f5 parallel tests and short/non-short mode 2025-03-04 16:18:34 +01:00
Denis Bilenko 62f1c36f89 lint fix 2025-03-04 16:11:50 +01:00
Andrew Nester 41961226be
Switch to use GET workspaces-files/{name} instead of workspace/export for state files (#2423) 
## Changes
Switch to use GET workspaces-files/{name} instead of workspace/export
for state files.

## Why
`/api/2.0./workspaces-files/{name}` has a higher limit which allows to
export state files larger than 10 MBs (which is the current limit for
`workspace/export`). We don't use the same API for read in other places
and fully replacing existing Filer because it doesn't correct get the
file content for notebooks and returns "File Not Found" error instead.

## Tests
All existing tests pass
 2025-03-04 15:03:51 +00:00
Denis Bilenko 18daa3feff clean up 2025-03-04 15:52:59 +01:00