af5659ae8e
Update databricks-sdk-go to latest ( #89 )
2022-11-09 15:01:47 +01:00
0601e114fd
[DECO-200] Ignore RESOURCE_DOES_NOT_EXIST errors on file deletion during sync ( #85 )
...
tested manually
2022-10-27 17:32:10 +02:00
1329bc05d4
Log initial sync complete ( #86 )
...
Tested manually
<img width="930" alt="Screenshot 2022-10-27 at 2 21 52 PM"
src="https://user-images.githubusercontent.com/88374338/198282897-ad0c3d62-be92-4ec4-a0e1-4df2a7eab2b9.png ">
2022-10-27 15:41:18 +02:00
18dae73505
[DECO-79][DECO-165] Incremental sync with support for multiple profiles ( #82 )
...
This PR does multiple things, which are:
1. Creates .databricks dir according to outcomes concluded in "bricks
configuration principles"
2. Puts the sync snapshots into a file whose names is tagged with
md5(concat(host, remote-path))
3. Saves both host and username in the bricks snapshot for debuggability
Tested manually:
https://user-images.githubusercontent.com/88374338/195672267-9dd90230-570f-49b7-847f-05a5a6fd8986.mov
2022-10-19 16:22:55 +02:00
0b754e6de8
[DECO-94] Execute uploads in parallel instead of sequentailly ( #81 )
...
Tested manually
Upload seems fast enough, delete API calls though have a much longer
turn around times
Additional optimizations that can be done if/when the need arises:
1. First time upload can be done using zip batching of the files
https://user-images.githubusercontent.com/88374338/192783332-9b2b19bc-d6c4-4a66-8dbc-e78287e6af1a.mov
2022-10-05 00:12:57 +02:00
a1b6fdb2e8
Update SDK ( #79 )
2022-09-27 09:58:55 -07:00
731679cb4b
Add `persist-snapshot` to bricks sync ( #66 )
...
Tested manually
We are adding this flag because the default bricks sync is not robust
against changing the profile and other project config changes. This will
be used in the initial version of the vscode extention
2022-09-19 16:47:55 +02:00
7cad8bda81
Respect project root in sync command ( #63 )
2022-09-16 15:18:46 +02:00
a7701cc8f3
Store project object in context.Context instead of global ( #61 )
...
* Load project root from `BRICKS_ROOT` environment variable
* Rename project.Project -> project.Config
* Rename project.inner -> project.project
* Upgrade cobra to 1.5.0 for cmd.SetContext
2022-09-16 11:06:58 +02:00
f9b66b3536
Make `bricks sync` feature work ( #48 )
...
Tested manually and partially by unit tests
2022-09-14 17:50:29 +02:00
32ae59c1bc
Experimental sync command
2022-07-07 20:56:59 +02:00
Pieter Noordhuis
shreyas-goenka
Serge Smertin
