Daily Incremental load ETL pipeline for Ecommerce company using AWS Lambda and AWS EMR cluster, Deployed using Apache airflow in a docker container.
docker dockerfile aws postgres lambda aws-lambda docker-compose docker-container aws-s3 lambda-functions postgresql aws-emr aws-ec2 redshift oltp aws-emr-clusters aws-glue redshift-aws glue-jobs lambda-trigger
-
Updated
Mar 17, 2023 - Python