mz-health/mz-pop-health
mz-health
/
mz-pop-health
1
0
Code Issues 5 Packages Projects Wiki

Explore OSS #4

New Issue
Open
opened 2024-10-03 20:28:10 +00:00 by steve · 3 comments
steve commented 2024-10-03 20:28:10 +00:00
Owner
Copy Link

Products

  • Apache Drill (Comes with Zookeeper)
  • Apache Druid
  • ClickHouse
  • PostgreSQL, MySQL
  • MsSQL - Microsoft
  • Apache Iceberg
  • pyiceberg (python plugin, will be needed for ETL)

Installation and Configuration

  • Work in a cohesive unit
**Products** - [x] Apache Drill (Comes with Zookeeper) - [ ] Apache Druid - [ ] ClickHouse - [x] PostgreSQL, MySQL - [ ] MsSQL - Microsoft - [x] Apache Iceberg - [ ] ~~pyiceberg (python plugin, will be needed for ETL)~~ Installation and Configuration - [ ] Work in a cohesive unit
steve self-assigned this 2024-10-03 20:28:10 +00:00
steve added this to the MZ-POP-HEALTH project 2024-10-03 20:28:10 +00:00
steve commented 2024-10-07 16:37:50 +00:00
Author
Owner
Copy Link
  • Apache Drill requires both zookeeper and some jdbc drivers (to store in 3rdparty)
  • Clickhouse may not be very practical because it requires structural specifications (schema)
  • Iceberg, build with spark (have the code hosted on hiplab later on)
- **Apache Drill** requires both zookeeper and some **jdbc drivers** (to store in 3rdparty) - **Clickhouse** may not be very practical because it requires structural specifications (schema) - **Iceberg**, build with spark (have the code hosted on hiplab later on)
steve commented 2024-10-16 20:20:13 +00:00
Author
Owner
Copy Link

data-transport 2.4 has support for iceberg (no streaming yet)

data-transport 2.4 has support for iceberg (no streaming yet)
steve commented 2024-10-17 03:45:03 +00:00
Author
Owner
Copy Link

  • Drill allows us to have visibility over all the databases (jdbc compatibility) including Iceberg

  • Instead of using pyIceberg, I opted for pyspark because pyIceberg is not compatible with python 3.9. I also have built support for iceberg to data-transport.

- **Drill** allows us to have visibility over all the databases (jdbc compatibility) including Iceberg - Instead of using pyIceberg, I opted for pyspark because pyIceberg is not compatible with python 3.9. I also have built support for iceberg to data-transport.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
MZ-POP-HEALTH
Assignees
Clear assignees
No Assignees
steve
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: mz-health/mz-pop-health#4
No description provided.
Delete Branch "%!s(<nil>)"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?