0601e114fd
[DECO-200] Ignore RESOURCE_DOES_NOT_EXIST errors on file deletion during sync ( #85 )
...
tested manually
2022-10-27 17:32:10 +02:00
1329bc05d4
Log initial sync complete ( #86 )
...
Tested manually
<img width="930" alt="Screenshot 2022-10-27 at 2 21 52 PM"
src="https://user-images.githubusercontent.com/88374338/198282897-ad0c3d62-be92-4ec4-a0e1-4df2a7eab2b9.png ">
2022-10-27 15:41:18 +02:00
18dae73505
[DECO-79][DECO-165] Incremental sync with support for multiple profiles ( #82 )
...
This PR does multiple things, which are:
1. Creates .databricks dir according to outcomes concluded in "bricks
configuration principles"
2. Puts the sync snapshots into a file whose names is tagged with
md5(concat(host, remote-path))
3. Saves both host and username in the bricks snapshot for debuggability
Tested manually:
https://user-images.githubusercontent.com/88374338/195672267-9dd90230-570f-49b7-847f-05a5a6fd8986.mov
2022-10-19 16:22:55 +02:00
38a9dabcbe
Add command to make API calls ( #80 )
...
Not settled whether this should live as a top level command or hidden
under some debug scope. Either way, the ability to make arbitrary API
calls and leverage unified auth is a super useful tool.
2022-10-10 10:27:45 +02:00
ed56fc01cb
[DECO-68] Modify acceptance test to work with deco testing infra and represent vscode usecase ( #78 )
...
Contains changes to make this integration test work on our GitHub
actions testing env
1. use go run main.go to run bricks sync to run the latest bricks from
master
2. Log the output from the bricks sync process to allow for debugging
3. removed databricks.yml and instead rely on BRICKS_ROOT and other env
vars for auth and bricks sync
4. Added --persist-snapshot set to false to test full sync (same as is
used in the vscode extension
<img width="898" alt="Screenshot 2022-09-27 at 4 26 18 PM"
src="https://user-images.githubusercontent.com/88374338/192553769-7af08ca0-b73a-4cf6-a214-8c58edc4c3e5.png ">
The additional logs in the picture above are from a wip PR in deco cli
that I made some changes to in order to make deco cli work with bricks :
https://github.com/databricks/eng-dev-ecosystem/pull/97
2022-10-05 13:28:53 +02:00
0b754e6de8
[DECO-94] Execute uploads in parallel instead of sequentailly ( #81 )
...
Tested manually
Upload seems fast enough, delete API calls though have a much longer
turn around times
Additional optimizations that can be done if/when the need arises:
1. First time upload can be done using zip batching of the files
https://user-images.githubusercontent.com/88374338/192783332-9b2b19bc-d6c4-4a66-8dbc-e78287e6af1a.mov
2022-10-05 00:12:57 +02:00
a1b6fdb2e8
Update SDK ( #79 )
2022-09-27 09:58:55 -07:00
f27cb7149d
Reduce nesting ( #72 )
2022-09-22 15:03:30 +02:00
6258a1637d
Add environments to project configuration ( #68 )
2022-09-22 13:40:11 +02:00
6bcb33bf07
Use env vars to read profile if databricks.yml is absent ( #70 )
...
Tested manually and by running sync_test.go integration test bricks sync
works
2022-09-21 13:55:37 +02:00
731679cb4b
Add `persist-snapshot` to bricks sync ( #66 )
...
Tested manually
We are adding this flag because the default bricks sync is not robust
against changing the profile and other project config changes. This will
be used in the initial version of the vscode extention
2022-09-19 16:47:55 +02:00
7cad8bda81
Respect project root in sync command ( #63 )
2022-09-16 15:18:46 +02:00
ec6c58f1d1
Fix relative path derivation if root path can be cleaned ( #64 )
2022-09-16 15:13:49 +02:00
a7701cc8f3
Store project object in context.Context instead of global ( #61 )
...
* Load project root from `BRICKS_ROOT` environment variable
* Rename project.Project -> project.Config
* Rename project.inner -> project.project
* Upgrade cobra to 1.5.0 for cmd.SetContext
2022-09-16 11:06:58 +02:00
836ab58473
Fix flaky test `TestDiff` ( #59 )
2022-09-15 15:40:47 +02:00
192a790155
Comment out flavor.go ( #60 )
...
The code here isn't used at the moment.
2022-09-15 09:46:11 +02:00
f9b66b3536
Make `bricks sync` feature work ( #48 )
...
Tested manually and partially by unit tests
2022-09-14 17:50:29 +02:00
281f25a627
Don't depend on working directory in folders.FindDirWithLeaf ( #54 )
...
This is plumbing for allowing a configurable root that doesn't depend on
the working directory.
2022-09-14 15:08:55 +02:00
14a45e701e
Run go mod tidy ( #55 )
2022-09-14 10:48:51 +02:00
40194cc1a2
Scope snippets to Go ( #51 )
...
Confirmed they only show up in Go code now.
2022-09-13 17:58:59 +02:00
a168eece47
Build 32 bit Windows ( #47 )
...
Win32 is needed by VSCode as a fallback.
2022-09-09 10:31:41 +02:00
21bc774491
Replace scim Me terraform call with go sdk ( #46 )
...
This PR:
1. Replaces scim.Me call to use the go SDK instead of the terraform
client
2. Removes terraform client from bricks project
Tested manually that the scim.Me call works now and returns the correct
user
go build works
2022-09-08 15:50:00 +02:00
d829ce36d5
fix release ( #45 )
2022-09-08 15:12:26 +02:00
f309f68444
Fix release action and make sure to also build for Windows ( #43 )
2022-09-08 14:57:33 +02:00
1ddba0caa8
Allow manually triggering releases
2022-09-08 14:13:43 +02:00
ea19417336
Also build for windows ( #42 )
2022-09-08 13:27:05 +02:00
d214f44df4
Use actions/setup-go@v3 with caching support ( #41 )
2022-09-08 11:21:00 +02:00
2e12a2aa01
Make tests pass ( #40 )
...
By:
* Add .gitkeep to retain test fixture directories under
./python/testdata
* Move GitHub related functionality to ./experimental (it is not in use)
* Comment out test in ./cmd/sync
* Fix test in ./git
2022-09-07 20:08:42 +02:00
5a55cad7c3
Ensure Go code is formatted ( #37 )
2022-09-07 15:15:23 +02:00
80a4c47d62
Fix lint error regarding struct with unexported fields ( #38 )
...
Unexported fields are skipped during marshalling, so this would be a
nop.
The code in `./cmd/sync/github*.go` is currently unused.
Confirmed that staticcheck passes when run with:
```
staticcheck -checks SA9005 ./...
```
2022-09-07 15:15:07 +02:00
c00db56d84
Fix lint errors for using deprecated functionality ( #35 )
...
Functionality from `io/ioutil` has moved to the `io` and `os` packages
in go1.16 ([reference](https://pkg.go.dev/io/ioutil )).
Confirmed that staticcheck passes when run with:
```
staticcheck -checks SA1019 ./...
```
2022-09-07 14:30:10 +02:00
31a841ff33
Fix lint errors for unused functions ( #36 )
...
The functionality under terraform/ isn't used anywhere at the moment and
the test doesn't pass for me. It will be useful down the line so
commenting out instead of removing.
Confirmed that staticcheck passes when run with:
```
staticcheck -checks U1000 ./...
```
2022-09-07 14:26:31 +02:00
67b2e4206f
Use t.Setenv instead of custom implementation ( #34 )
...
Follow up for #18 . This function was introduced in go1.17. As of #19 we
require go1.18, so we can use it.
2022-09-07 13:24:11 +02:00
96efd0e2e4
Replace terraform dependency with go sdk ( #19 )
...
Issue: https://github.com/databricks/bricks/issues/17
`./bricks fs ls ...` command works
`./bricks launch ...` command works
Did not test other changes as the readme claims other commands don't
work anyways :) cc: @nfx
TODO left for this PR:
2. Replace terraform scim.Me once its there in go SDK
(https://github.com/databricks/databricks-sdk-go/issues/56 )
2022-09-07 11:55:59 +02:00
f070c24399
Write default header only if `DEFAULT` section exists ( #31 )
2022-09-06 18:04:05 +02:00
30a7de621a
Add more flags to `configure` command ( #29 )
2022-09-06 16:37:58 +02:00
457f3ad3c2
Add `bricks configure` command to bricks CLI ( #18 )
...
* bricks configure
* remove t.setenv
* Read token and host from stdin
* Update .vscode/testing.code-snippets
Co-authored-by: Serge Smertin <259697+nfx@users.noreply.github.com>
Co-authored-by: Serge Smertin <259697+nfx@users.noreply.github.com>
2022-09-05 20:25:54 +02:00
bb50563c60
Bump github.com/stretchr/testify from 1.7.1 to 1.8.0 ( #13 )
...
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify ) from 1.7.1 to 1.8.0.
- [Release notes](https://github.com/stretchr/testify/releases )
- [Commits](https://github.com/stretchr/testify/compare/v1.7.1...v1.8.0 )
---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-02 14:00:38 +02:00
081f039a93
Bump gopkg.in/ini.v1 from 1.66.4 to 1.67.0 ( #16 )
...
Bumps [gopkg.in/ini.v1](https://github.com/go-ini/ini ) from 1.66.4 to 1.67.0.
- [Release notes](https://github.com/go-ini/ini/releases )
- [Commits](https://github.com/go-ini/ini/compare/v1.66.4...v1.67.0 )
---
updated-dependencies:
- dependency-name: gopkg.in/ini.v1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-02 14:00:16 +02:00
f70d42fff6
Revert "Added go sdk as a dependency"
...
This reverts commit 0ae8b60573
2022-09-01 13:42:35 +02:00
9951068c62
Revert "Using go sdk for ./bricks fs ls DIR_NAME command"
...
This reverts commit 6217d20e57
2022-09-01 13:42:34 +02:00
5e2c5888e0
Revert "Replaced usage of Cluster struct from terraform provider to ClusterInfo from go-sdk in config.go"
...
This reverts commit a9a7672725
2022-09-01 13:42:31 +02:00
a9a7672725
Replaced usage of Cluster struct from terraform provider to ClusterInfo from go-sdk in config.go
2022-08-31 19:46:35 +02:00
6217d20e57
Using go sdk for ./bricks fs ls DIR_NAME command
2022-08-31 19:31:58 +02:00
0ae8b60573
Added go sdk as a dependency
2022-08-31 19:05:05 +02:00
32ae59c1bc
Experimental sync command
2022-07-07 20:56:59 +02:00
95a68937fe
rename `internal/test` to idiomatic `testdata`
2022-05-23 11:46:37 +02:00
0d76ab3d28
upload wheel to pep503-compatible DBFS path
2022-05-23 11:41:55 +02:00
82438b9f1c
Bump github.com/databrickslabs/terraform-provider-databricks ( #1 )
...
Bumps [github.com/databrickslabs/terraform-provider-databricks](https://github.com/databrickslabs/terraform-provider-databricks ) from 0.5.7 to 0.5.8.
- [Release notes](https://github.com/databrickslabs/terraform-provider-databricks/releases )
- [Changelog](https://github.com/databrickslabs/terraform-provider-databricks/blob/master/CHANGELOG.md )
- [Commits](https://github.com/databrickslabs/terraform-provider-databricks/compare/v0.5.7...v0.5.8 )
---
updated-dependencies:
- dependency-name: github.com/databrickslabs/terraform-provider-databricks
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-23 10:49:35 +02:00
515a6930f8
interation on `.tfstate` sync stability
...
* read `serial` from `.tfstate`.
* defer local `.tfstate` handle closing on method exits.
* document private methods not to forget their intentions.
2022-05-23 10:34:58 +02:00
shreyas-goenka
Pieter Noordhuis
Serge Smertin
Fabian Jakobs
Pieter Noordhuis
Kartik Gupta
dependabot[bot]
Shreyas Goenka
Serge Smertin
