You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It looks as though the bigquery api supports resumable upload, but there is only a resumable upload module built for storage.
This may be enough, given that you can import data to bigquery from storage, but I just wanted to check in and see if it made sense to include resumable upload support directly for bigquery as well.
The text was updated successfully, but these errors were encountered:
I think the Storage -> BigQuery import is a better alternative here. Resumable uploads come with a lot of overhead in the implementation as well as on the user-- persisting a config file is unexpected.
Anyone feel free to discuss and re-open if this is something we need to support.
Is there any reason that this can't be done under the hood as part of table.createWriteStream from the Bigquery module, just as it's done for file.createWriteStream in the GCS module?
It looks as though the bigquery api supports resumable upload, but there is only a resumable upload module built for storage.
This may be enough, given that you can import data to bigquery from storage, but I just wanted to check in and see if it made sense to include resumable upload support directly for bigquery as well.
The text was updated successfully, but these errors were encountered: