Stream processing and management platform.
-
Updated
Jun 5, 2025 - Rust
#
apache-iceberg
Here are 78 public repositories matching this topic...
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
rust aws security cloud big-data serverless alerting dfir secops cybersecurity cloud-native threat-hunting siem log-management aws-security security-tools cloud-security log-analytics apache-iceberg detection-engineering
-
Updated
Jan 8, 2025 - Rust
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
-
Updated
Jun 4, 2025 - Java
Fastest open-source tool for replicating Databases to Data Lake in Open Table Formats like Apache Iceberg. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL
-
Updated
Jun 5, 2025 - Go
Apache Kafka® compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake
postgres postgresql s3 parquet apache-kafka datalake apache-arrow apache-iceberg delta-lake datafusion built-with-rust
-
Updated
Jun 3, 2025 - Rust
Use SQL to build ELT pipelines on a data lakehouse.
sql apache-spark etl pipelines data-engineering data-lake data-transfer delta data-integration upsert elt data-pipeline datalake data-ingestion spark-sql zeppelin-notebook apache-iceberg lakehouse incremental-updates
-
Updated
May 25, 2022 - JavaScript
Lakehouse storage system benchmark
-
Updated
Feb 22, 2023 - Scala
Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.
-
Updated
Sep 2, 2023 - Dockerfile
Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
-
Updated
Jul 13, 2022 - Jupyter Notebook
📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
docker open-source aws big-data etl s3 data-visualization data-engineering minio apache-flink apache-kafka real-time-data data-pipeline trino streaming-analytics apache-superset apache-iceberg lakehouse sql-analytics
-
Updated
Jan 18, 2025 - Python
Icebird: JavaScript Iceberg Client
-
Updated
May 8, 2025 - JavaScript
Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS
-
Updated
Feb 15, 2025 - Python
Spark data pipeline that processes movie ratings data.
-
Updated
Jun 1, 2025 - Python
An open-source, community-driven REST catalog for Apache Iceberg!
-
Updated
Jun 26, 2024 - Go
Sample code to collect Apache Iceberg metrics for table monitoring
aws apache-spark monitoring aws-lambda aws-cloudwatch data-quality aws-glue sam-cli apache-iceberg pyiceberg
-
Updated
Aug 18, 2024 - Python
This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.
-
Updated
Nov 14, 2024 - Java
DAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS using the next generation Amazon SageMaker Unified Studio. The goal of the DAIVI solution is to provide engineers with sample infrastructure-as-code modules and application modules to build their data platforms.
-
Updated
May 28, 2025 - HCL
Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3
-
Updated
Sep 10, 2024 - Python
A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
-
Updated
May 30, 2022 - Java
Improve this page
Add a description, image, and links to the apache-iceberg topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-iceberg topic, visit your repo's landing page and select "manage topics."