4 Commits

Author	SHA1	Message	Date
Pieter Noordhuis	33c446dadd	Refactor library to artifact matching to not use pointers (#1172) ... ## Changes The approach to do this was: 1. Iterate over all libraries in all job tasks 2. Find references to local libraries 3. Store pointer to `compute.Library` in the matching artifact file to signal it should be uploaded This breaks down when introducing #1098 because we can no longer track unexported state across mutators. The approach in this PR performs the path matching twice; once in the matching mutator where we check if each referenced file has an artifacts section, and once during artifact upload to rewrite the library path from a local file reference to an absolute Databricks path. ## Tests Integration tests pass.	2024-02-05 15:29:45 +00:00
Andrew Nester	8d8de3f509	Fixed using repo files as pipeline libraries (#847) ... ## Changes Fixed using repo files as pipeline libraries ## Tests Added regression test	2023-10-09 10:10:28 +00:00
Andrew Nester	e64463ba47	Fixed marking libraries from DBFS as remote (#750) ... ## Changes Fixed marking libraries from DBFS as remote ## Tests Updated unit tests to catch the regression	2023-09-08 09:53:57 +00:00
Andrew Nester	842cd8b7ae	Correctly identify local paths in libraries section (#702) ... ## Changes Fixes #699 ## Tests Added unit test	2023-08-29 08:26:09 +00:00