ValueError: Please install the 'db-dtypes' package to use this function.

[chhabrakadabra]

Expected Behavior

If I install feast with the [gcp] extra, I should be able to use BigQueryRetrievalJob.to_bigquery() without problems.

Current Behavior

When feast is installed with the [gcp] extra, it installs google-cloud-bigquery as per this line. It does not use the pandas extra, which means nothing triggers the installation of the db-dtypes package.

When bigquery.py uses to_dataframe() on the result of a BQ query as done here, it triggers a verification of imports available, which causes the exception here.

Steps to reproduce

Install feast[gcp] and use BigQueryRetrievalJob.to_bigquery().

Specifications

• Version: feast[gcp]==0.16.1
• Platform: OSX
• Subsystem: Not sure what this is referring to

Possible Solution

Use google-cloud-bigquery[pandas] for the [gcp] extra.

[felixwang9817]

Hey @chhabrakadabra, thanks for reporting this issue. What version of google-cloud-bigquery do you have? I suspect the issue is that google-cloud-bigquery recently released v3.0.0 which had the db-dtypes breaking change. See this release and this migration guide for more details. Can you try reverting to google-cloud-bigquery<3.0.0 and seeing if this error still persists? I'm on 2.34.1 and it works fine for me.

I'll keep this issue open to track an upgrade to v3.0.0.

[felixwang9817]

I believe #2554 should have resolved this issue, so I'll close it now. If for some reason the bug persists, please feel to reopen it @chhabrakadabra!

[michaelzolo]

For me this bug still persists. I'm using google-cloud-bigquery 3.0.1

[jerinscaria]

Issue persists google-cloud-bigquery version 3.1.0

[felixwang9817]

hey @michaelzolo and @jerinscaria, we still haven't upgraded to support bigquery >=3.0.0, so I would recommend using bigquery <3 for now