mirror of https://github.com/databricks/cli.git
## Changes Rewrite bundle/tests/python_wheel_test.go into acceptance tests. The same configs are used, but the test now runs 'bundle deploy' and in addition to checking the files on the file system, also checks that the files were uploaded and records jobs/create request. There is a new test helper bin/find.py which filters out paths based on regex, asserts on number of expected results. I've added it because 'find' on Windows behaves differently, so this helps avoid cross-platform differences. |
||
---|---|---|
.. | ||
auth | ||
bin | ||
bundle | ||
cmd/workspace/apps | ||
help | ||
panic | ||
selftest | ||
terraform | ||
workspace/jobs | ||
.gitignore | ||
README.md | ||
acceptance_test.go | ||
cmd_server_test.go | ||
config_test.go | ||
install_terraform.py | ||
script.cleanup | ||
script.prepare | ||
server_test.go | ||
test.toml |
README.md
Acceptance tests are blackbox tests that are run against compiled binary.
Currently these tests are run against "fake" HTTP server pretending to be Databricks API. However, they will be extended to run against real environment as regular integration tests.
To author a test,
- Add a new directory under
acceptance
. Any level of nesting is supported. - Add
databricks.yml
there. - Add
script
with commands to run, e.g.$CLI bundle validate
. The test case is recognized by presence ofscript
.
The test runner will run script and capture output and compare it with output.txt
file in the same directory.
In order to write output.txt
for the first time or overwrite it with the current output pass -update flag to go test.
The scripts are run with bash -e
so any errors will be propagated. They are captured in output.txt
by appending Exit code: N
line at the end.
For more complex tests one can also use:
errcode
helper: if the command fails with non-zero code, it appendsExit code: N
to the output but returns success to caller (bash), allowing continuation of script.trace
helper: prints the arguments before executing the command.- custom output files: redirect output to custom file (it must start with
out
), e.g.$CLI bundle validate > out.txt 2> out.error.txt
.
See selftest for a toy test.