steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Databricks CLI
71 Commits 85 Branches 104 Tags 56 MiB
Go 99.6%
Python 0.2%
Shell 0.2%
Go to file
shreyas-goenka 0b754e6de8
[DECO-94] Execute uploads in parallel instead of sequentailly (#81) 
Tested manually

Upload seems fast enough, delete API calls though have a much longer
turn around times

Additional optimizations that can be done if/when the need arises:
1. First time upload can be done using zip batching of the files


https://user-images.githubusercontent.com/88374338/192783332-9b2b19bc-d6c4-4a66-8dbc-e78287e6af1a.mov
 		2022-10-05 00:12:57 +02:00
.github fix release (#45) 2022-09-08 15:12:26 +02:00
.vscode Scope snippets to Go (#51) 2022-09-13 17:58:59 +02:00
cmd [DECO-94] Execute uploads in parallel instead of sequentailly (#81) 2022-10-05 00:12:57 +02:00
experimental/github Make tests pass (#40) 2022-09-07 20:08:42 +02:00
ext Update SDK (#79) 2022-09-27 09:58:55 -07:00
folders Don't depend on working directory in folders.FindDirWithLeaf (#54) 2022-09-14 15:08:55 +02:00
git Respect project root in sync command (#63) 2022-09-16 15:18:46 +02:00
internal Update SDK (#79) 2022-09-27 09:58:55 -07:00
project Update SDK (#79) 2022-09-27 09:58:55 -07:00
python Store project object in context.Context instead of global (#61) 2022-09-16 11:06:58 +02:00
retries Experimental sync command 2022-07-07 20:56:59 +02:00
sandbox updated dependencies 2022-05-14 19:56:09 +02:00
terraform Ensure Go code is formatted (#37) 2022-09-07 15:15:23 +02:00
utilities Update SDK (#79) 2022-09-27 09:58:55 -07:00
.gitignore Experimental sync command 2022-07-07 20:56:59 +02:00
.gitmodules Replace terraform dependency with go sdk (#19) 2022-09-07 11:55:59 +02:00
.goreleaser.yaml Build 32 bit Windows (#47) 2022-09-09 10:31:41 +02:00
Makefile updated dependencies 2022-05-14 19:56:09 +02:00
README.md Update README.md 2022-05-16 13:31:47 +02:00
go.mod [DECO-94] Execute uploads in parallel instead of sequentailly (#81) 2022-10-05 00:12:57 +02:00
go.sum [DECO-94] Execute uploads in parallel instead of sequentailly (#81) 2022-10-05 00:12:57 +02:00
main.go Add `bricks configure` command to bricks CLI (#18) 2022-09-05 20:25:54 +02:00

README.md

Bricks CLI 🧱 build

Where's "data"? Secured by the unity catalog. Projects build lifecycle is secured by bricks 🧱

This is an early PoC at this stage. make build (or download the latest from releases page).

Reuses authentication from Databricks CLI. And terraform provider. See details here: https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs#environment-variables

Supports:

  • Databricks CLI
  • Databricks CLI Profiles
  • Azure CLI Auth
  • Azure MSI Auth
  • Azure SPN Auth
  • Google OIDC Auth
  • Direct DATABRICKS_HOST, DATABRICKS_TOKEN or DATABRICKS_USERNAME + DATABRICKS_PASSWORD variables.

What works:

  • ./bricks fs ls /
  • ./bricks test
  • ./bricks launch test.py

What doesn't work:

  • Everything else.

This project reuses some code from Databricks Terraform Provider