steve/databricks-cli
steve
/
databricks-cli
mirror of https://github.com/databricks/cli.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
213 Commits 94 Branches 105 Tags 59 MiB
Commit Graph

16 Commits

Author SHA1 Message Date
Shreyas Goenka 07c8dbcc56
invert print order 2023-03-09 23:18:19 +01:00
Shreyas Goenka 78b0cfd008
added multiple event logging and event type information 2023-03-09 23:12:11 +01:00
Shreyas Goenka 9c5541e1d1
nit 2023-03-09 16:45:40 +01:00
Shreyas Goenka db7c1fc0d4
remove internal ref 2023-03-09 16:44:49 +01:00
Shreyas Goenka a22ee2e1e6
log log failure 2023-03-09 01:48:34 +01:00
Shreyas Goenka 8504e47917
nit 2023-03-09 01:34:26 +01:00
Shreyas Goenka 4f961baa36
nit 2023-03-09 01:33:52 +01:00
Shreyas Goenka 0838b0d26a
added filter for updateId 2023-03-09 01:26:14 +01:00
Shreyas Goenka 3f6f643407
Show error trace on pipeline run failure 2023-03-09 01:07:38 +01:00
shreyas-goenka f93b541b63
Show detailed error logs for jobs (#209) 
PR for how to render errors on console for jobs. 
Here is the bundle used for the logs below:
```
bundle:
  name: deco-438

workspace:
  host: https://adb-309687753508875.15.azuredatabricks.net

resources:
  jobs:
    foo:
      name: "[${bundle.name}][${bundle.environment}] a test notebook"

      tasks:
        - task_key: alpha
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/Users/shreyas.goenka@databricks.com/[deco-438] invalid notebook"
        - task_key: beta
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/does-not-exist"
        - task_key: gamma
          existing_cluster_id: 1109-115254-ox7poobk
          notebook_task:
            notebook_path: "/Users/shreyas.goenka@databricks.com/[deco-438] valid notebook"
```

And this is a screenshot of the logs from the console:
<img width="1057" alt="Screenshot 2023-02-17 at 7 12 29 PM"
src="https://user-images.githubusercontent.com/88374338/219744768-ab7f1e79-db8f-466a-ad6d-f2b6f85ed17c.png">

Here are the logs when only tasks gamma is executed (successfully):
<img width="1059" alt="Screenshot 2023-02-17 at 7 13 04 PM"
src="https://user-images.githubusercontent.com/88374338/219744992-011d8b91-ec1d-44f0-a849-83c81816dd9f.png">


TODO: Investigate more possible job errors, and make sure state for them
is handled in a robust way here
 2023-02-20 23:40:14 +01:00
Pieter Noordhuis dd95668474
Complete positional argument to bundle run (#220) 
Command completion can be configured through `bricks completion`.
 2023-02-20 21:55:06 +01:00
Pieter Noordhuis 3582037be6
Add nil check for retries.Info.Info (#166) 2023-01-12 18:58:36 +01:00
Pieter Noordhuis 8f4461904b
Define flags for running jobs and pipelines (#146) 2022-12-23 15:17:16 +01:00
Pieter Noordhuis 49aa858b89
Run command must always take a single argument (#156) 2022-12-22 16:19:38 +01:00
Pieter Noordhuis 7f83463ca3
Bump SDK to latest (#151) 2022-12-22 09:46:17 +01:00
Pieter Noordhuis b111416fe5
Add `bricks bundle run` command (#134) 2022-12-15 15:12:47 +01:00