steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
229 Commits 84 Branches 104 Tags 56 MiB
Commit Graph

17 Commits

Author SHA1 Message Date
Shreyas Goenka 8c7f335364
switch to go sdk 2023-03-15 04:08:56 +01:00
Shreyas Goenka 07c8dbcc56
invert print order 2023-03-09 23:18:19 +01:00
Shreyas Goenka 78b0cfd008
added multiple event logging and event type information 2023-03-09 23:12:11 +01:00
Shreyas Goenka 9c5541e1d1
nit 2023-03-09 16:45:40 +01:00
Shreyas Goenka db7c1fc0d4
remove internal ref 2023-03-09 16:44:49 +01:00
Shreyas Goenka a22ee2e1e6
log log failure 2023-03-09 01:48:34 +01:00
Shreyas Goenka 8504e47917
nit 2023-03-09 01:34:26 +01:00
Shreyas Goenka 4f961baa36
nit 2023-03-09 01:33:52 +01:00
Shreyas Goenka 0838b0d26a
added filter for updateId 2023-03-09 01:26:14 +01:00
Shreyas Goenka 3f6f643407
Show error trace on pipeline run failure 2023-03-09 01:07:38 +01:00
shreyas-goenka f93b541b63
Show detailed error logs for jobs (#209) 
PR for how to render errors on console for jobs. 
Here is the bundle used for the logs below:
```
bundle:
  name: deco-438

workspace:
  host: https://adb-309687753508875.15.azuredatabricks.net

resources:
  jobs:
    foo:
      name: "[${bundle.name}][${bundle.environment}] a test notebook"

      tasks:
        - task_key: alpha
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/Users/shreyas.goenka@databricks.com/[deco-438] invalid notebook"
        - task_key: beta
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/does-not-exist"
        - task_key: gamma
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/Users/shreyas.goenka@databricks.com/[deco-438] valid notebook"
```

And this is a screenshot of the logs from the console:
<img width="1057" alt="Screenshot 2023-02-17 at 7 12 29 PM"
src="https://user-images.githubusercontent.com/88374338/219744768-ab7f1e79-db8f-466a-ad6d-f2b6f85ed17c.png">

Here are the logs when only tasks gamma is executed (successfully):
<img width="1059" alt="Screenshot 2023-02-17 at 7 13 04 PM"
src="https://user-images.githubusercontent.com/88374338/219744992-011d8b91-ec1d-44f0-a849-83c81816dd9f.png">


TODO: Investigate more possible job errors, and make sure state for them
is handled in a robust way here
 2023-02-20 23:40:14 +01:00
Pieter Noordhuis dd95668474
Complete positional argument to bundle run (#220) 
Command completion can be configured through `bricks completion`.
 2023-02-20 21:55:06 +01:00
Pieter Noordhuis 3582037be6
Add nil check for retries.Info.Info (#166) 2023-01-12 18:58:36 +01:00
Pieter Noordhuis 8f4461904b
Define flags for running jobs and pipelines (#146) 2022-12-23 15:17:16 +01:00
Pieter Noordhuis 49aa858b89
Run command must always take a single argument (#156) 2022-12-22 16:19:38 +01:00
Pieter Noordhuis 7f83463ca3
Bump SDK to latest (#151) 2022-12-22 09:46:17 +01:00
Pieter Noordhuis b111416fe5
Add `bricks bundle run` command (#134) 2022-12-15 15:12:47 +01:00