Commit Graph

183 Commits

Author SHA1 Message Date
Steve Nyemba 40f9c3930a bug fixes, using boto3 instead of boto for s3 support 2024-07-10 15:50:46 -05:00
Steve Nyemba 6f6fd48982 bug fixes: environment variable usage 2024-06-25 11:48:57 -05:00
Steve Nyemba 808378afdb bug fix: delegate (new feature) 2024-06-19 09:22:56 -05:00
Steve Nyemba 235a44be66 bug fix: registry and parameter handling 2024-06-19 08:38:46 -05:00
Steve Nyemba 037019c1d7 bug fix 2024-06-15 01:12:29 -05:00
Steve Nyemba c443c6c953 duckdb support 2024-06-15 00:50:53 -05:00
Steve Nyemba 8aa6f2c93d bug fix: improve handling in registry 2024-06-14 20:05:12 -05:00
Steve Nyemba 24cdd9f8fe bug fix: print statement 2024-06-14 19:56:42 -05:00
Steve Nyemba b9bc898161 bug fix: registry (more usable) and added to factory method 2024-06-14 15:30:09 -05:00
Steve Nyemba 6544bf852a feature: registry for security and enterprise use 2024-06-14 14:14:12 -05:00
Steve Nyemba 870c1caed3 bug fix: use plugins to refer to plugins 2024-06-10 01:03:59 -05:00
Steve Nyemba f5187790ce refactor: etl,better reusability & streamlined and threaded 2024-06-10 00:42:42 -05:00
Steve Nyemba 5adbb5a61e bug fixes and documentation 2024-04-24 13:00:03 -05:00
Steve Nyemba 67b91b43ab new: sqlserver and other refactoring 2024-04-23 13:00:14 -05:00
Steve Nyemba f6919ccd93 bug fix: set function mongodb used for updates 2024-04-16 09:42:33 -05:00
Steve Nyemba e1763b1b19 bug fix: ETL, Mongodb 2024-04-02 20:59:01 -05:00
Steve Nyemba 677239585c bug fix, with bigquery write 2024-04-02 16:58:58 -05:00
Steve Nyemba 9d75d42017 bug fix: append mode/replace or truncate upon insert 2024-04-02 12:59:26 -05:00
Steve Nyemba eb81f5a4d2 bug fix: mongodb inserts of structured objects with lists as elements 2024-04-02 12:31:41 -05:00
Steve Nyemba 549cc20824 bug fix ... 2024-04-01 16:12:04 -05:00
Steve Nyemba 165f9913b5 bug fix: imports providers (backward compatibility) 2024-04-01 16:04:00 -05:00
Steve Nyemba edd3efd328 bug fixes: imports 2024-04-01 15:41:39 -05:00
Steve Nyemba 383f887db6 V2.0 plugin support 2024-04-01 14:30:00 -05:00
Steve Nyemba eed612b396 bug fix: import 2024-04-01 14:09:45 -05:00
Steve Nyemba 6f7d912e20 bug fix/refactoring commong IEncoder 2024-04-01 14:06:34 -05:00
Steve Nyemba 0cf56f3e8f refactoring V2.0 2024-04-01 13:28:13 -05:00
Steve Nyemba b160d0a295 housekeeping work 2024-04-01 13:27:14 -05:00
Steve Nyemba fd899f5549 adding wrapper class/design pattern to support plugins 2024-04-01 12:52:42 -05:00
Steve Nyemba 6feae101b0 bug fixes: and support for plugins 2024-04-01 12:52:06 -05:00
Steve Nyemba e7838f5de1 refactoring version 2.0 2024-03-28 15:34:39 -05:00
Steve Nyemba 764b3d6af0 bug fix: psycopg2 with numpy 2024-02-27 12:37:16 -06:00
Steve Nyemba 95ad4c1a6b version 2.0-RC (2024) 2024-02-19 15:36:09 -06:00
Steve Nyemba 0f60c748ba bug fix 2024-02-05 22:35:14 -06:00
Steve Nyemba c3ebd32a40 bug fixes: sqlite writer with sqlalchemy 2024-02-02 19:19:23 -06:00
Steve Nyemba c3fd371cb7 bug fixes: sqlite writer with sqlalchemy 2024-02-02 19:18:23 -06:00
Steve Nyemba 0ac7e68bbd bug fixes: sqlite writer with sqlalchemy 2024-02-02 18:22:17 -06:00
Steve Nyemba 9270695c95 bug fixes: sqlite writer with sqlalchemy 2024-02-02 18:16:34 -06:00
Steve Nyemba e4faac7d6e bug fixes: sqlite writer with sqlalchemy 2024-02-02 18:11:20 -06:00
Steve Nyemba 35b261edbf bug fix: etl, mongodb 2024-01-19 23:55:35 -06:00
Steve Nyemba 1ca99dc820 bug fix: information 2024-01-15 16:52:12 -06:00
Steve Nyemba c6ff08ea6b bug fix: added info package with version & author 2024-01-15 15:08:18 -06:00
Steve Nyemba c27beb16cc providers ... version 2.0 prep 2024-01-08 10:24:29 -06:00
Steve Nyemba cedab73e19 bigquery: job submission and status of said jobs 2024-01-08 09:55:58 -06:00
Steve L. Nyemba 98964a623d
Merge pull request #7 from lnyemba/dev
bug fix: etl job and segments
2023-12-26 14:58:51 -06:00
Steve Nyemba 01d92c48b4 job delay ... 2023-12-26 14:56:03 -06:00
Steve Nyemba 88b0437bbc bug fix: etl jobs 2023-12-26 14:51:28 -06:00
Steve Nyemba 81bc5a3ba1 bug fix: bigquery chunk/batch sizes 2023-12-22 14:02:32 -06:00
Steve Nyemba fbfaaebbdc adding alias CALLBACK == QLISTENER 2023-12-20 10:14:15 -06:00
Steve Nyemba e46ebadcc2 bug fix 2023-12-11 22:10:53 -06:00
Steve Nyemba d74372f645 bug fixes: mongodb, common, nextcloud 2023-12-08 18:19:46 -06:00