Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.
-
Updated
Sep 2, 2023 - Dockerfile
#
data-lake
Here are 5 public repositories matching this topic...
BigData Pipeline is a local testing environment for experimenting with various storage solutions (RDB, HDFS), query engines (Trino), schedulers (Airflow), and ETL/ELT tools (DBT). It supports MySQL, Hadoop, Hive, Kudu, and more.
mysql docker airflow big-data hive hadoop docker-compose kudu distributed-computing data-warehouse mysql-server data-lake dbt airflow-docker trino hiveql airflow-dags dbt-core trino-cli data-lakestore
-
Updated
Nov 2, 2024 - Dockerfile
Analysis, extraction, infrastructure, and transformations of our data
-
Updated
Aug 15, 2024 - Dockerfile
Improve this page
Add a description, image, and links to the data-lake topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-lake topic, visit your repo's landing page and select "manage topics."