Skip to content

Modified version of week four provided looader script to load taxi data into bigquery

Notifications You must be signed in to change notification settings

jeffgolden/ZoomCampDE-load-script

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Zoomcamp Date Engineer Course Script to load and clean required files to GC storage

The original script was from here

https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/week_3_data_warehouse/extras

This script has been modified to clean up the data types and rename the fields as lowercase before uploading them as parquet files. It has also been modified to separate the extract (download), transformation, and load into separate routines to allow them to be run independently (mainly to avoid redownloading files as I was debugging)

About

Modified version of week four provided looader script to load taxi data into bigquery

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages