databricks-cli/bundle/schema
shreyas-goenka fa37449f1f
Require include glob patterns to be explicitly defined (#602)
## Changes
Before this PR we would load all yaml files matching * and \*/\*.yml
files as bundle configurations. This was problematic since this would
also load yaml files that were not meant to be a part of the bundle

## Tests
Manually, now files are no longer included unless manually specified
2023-07-25 10:00:46 +02:00
..
docs Require include glob patterns to be explicitly defined (#602) 2023-07-25 10:00:46 +02:00
README.md Rename bricks -> databricks (#389) 2023-05-16 18:35:39 +02:00
docs.go Rename bricks -> databricks (#389) 2023-05-16 18:35:39 +02:00
docs_test.go Add openapi descriptions to bundle resources (#229) 2023-03-15 03:18:51 +01:00
openapi.go Update inline JSON schema documentation (#557) 2023-07-07 13:00:12 +00:00
openapi_test.go Use tracker for reference loop tracking (#252) 2023-03-16 12:57:57 +01:00
schema.go Add readonly bundle tag for internal fields (#302) 2023-04-04 12:16:07 +02:00
schema_test.go Add readonly bundle tag for internal fields (#302) 2023-04-04 12:16:07 +02:00
tracker.go Use tracker for reference loop tracking (#252) 2023-03-16 12:57:57 +01:00

README.md

Overview

docs/bundle_descriptions.json contains both autogenerated as well as manually written descriptions for the json schema. Specifically

  1. resources : almost all descriptions are autogenerated from the OpenAPI spec
  2. environments : almost all descriptions are copied over from root level entities (eg: bundle, artifacts)
  3. bundle : manually editted
  4. include : manually editted
  5. workspace : manually editted
  6. artifacts : manually editted

These descriptions are rendered in the inline documentation in an IDE

SOP: Add schema descriptions for new fields in bundle config

  1. You can autogenerate empty descriptions for the new fields by running databricks bundle schema --only-docs > ~/databricks/bundle/schema/docs/bundle_descriptions.json
  2. Manually edit bundle_descriptions.json to add your descriptions
  3. Build again to embed the new bundle_descriptions.json into the binary (go build)
  4. Again run databricks bundle schema --only-docs > ~/databricks/bundle/schema/docs/bundle_descriptions.json to copy over any applicable descriptions to environments
  5. push to repo

SOP: Update descriptions in resources from a newer openapi spec

  1. Run databricks bundle schema --only-docs --openapi PATH_TO_SPEC > ~/databricks/bundle/schema/docs/bundle_descriptions.json
  2. push to repo