data-transport: Warehousing #6

Closed
opened 2024-10-18 17:12:40 +00:00 by steve · 1 comment
Owner

Data Transport framework should add support for warehousing infrastructure/technolgies:

  • Apache Drill
  • Apache Iceberg

Additionally the ETL can be affected and thus it is important to add streaming (at least the reads)

  • SQLAlchemy based Streaming
  • Druid Streaming
Data Transport framework should add support for warehousing infrastructure/technolgies: - [x] Apache Drill - [x] Apache Iceberg Additionally the ETL can be affected and thus it is important to add streaming (at least the reads) - [x] SQLAlchemy based Streaming - [x] Druid Streaming
steve self-assigned this 2024-10-18 17:12:40 +00:00
steve added this to the MZ-HEALTH project 2024-10-18 17:12:40 +00:00
Author
Owner

We can now run basic ETL with streaming support

We can now run basic ETL with streaming support
steve added this to the version 0.1 milestone 2024-10-18 17:15:02 +00:00
steve closed this issue 2024-10-18 17:16:37 +00:00
Sign in to join this conversation.
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: mz-health/mz-pop-health#6
No description provided.