Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

xESMF error after 12+ hour script run in downscaling grid/upsampling data #126

Open
jwynnsmith opened this issue Feb 11, 2022 · 2 comments

Comments

@jwynnsmith
Copy link

I am working with xesmf downscale a grid and upsample high resolution GLM data (5424 x 5424) to a global climate model grid which is 1.25 degree lon x 1 degree lat.

After forming a netcdf file of an xarray data array I used the commands as instructed for curvilinear grids on this page: https://xesmf.readthedocs.io/en/latest/notebooks/Curvilinear_grid.html

Here are the commands:

ds_out = xe.util.grid_global(1, 1.25)

regridder = xe.Regridder(ds, ds_out, "bilinear", periodic=True)
glm_ff_downscale = regridder(glm_ff)
After a 12+ hour run of the python script, I obtained this error:

Traceback (most recent call last):
File "lat_lon_xesmf2.py", line 60, in
regridder = xe.Regridder(ds, ds_out, "bilinear")
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/xesmf/frontend.py", line 772, in init
super().init(grid_in, grid_out, method, input_dims=input_dims, **kwargs)
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/xesmf/frontend.py", line 315, in init
weights = self._compute_weights() # Dictionary of weights
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/xesmf/frontend.py", line 375, in _compute_weights
ignore_degenerate=self.ignore_degenerate,
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/xesmf/backend.py", line 481, in esmf_regrid_build
regrid = ESMF.Regrid(sourcefield, destfield, **kwargs)
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/ESMF/util/decorators.py", line 64, in new_func
return func(*args, **kwargs)
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/ESMF/api/regrid.py", line 185, in init
dstFracField=dst_frac_field
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/ESMF/interface/cbindings.py", line 2068, in ESMP_FieldRegridStore
handle_esmf_error(rc, 'ESMC_FieldRegridStore')
File "/app/spack/v0.15/linux-rhel7-x86_64/gcc-4.8.5/python/3.7.7-d6cyi6ophaei6arnmzya2kn6yumye2yl/lib/python3.7/site-packages/ESMF/interface/cbindings.py", line 26, in handle_esmf_error
raise ValueError(msg)
ValueError: ESMC_FieldRegridStore failed with rc = 506. Please check the log files (named "*ESMF_LogFile").


I looked in the error log file listed above and did not know what to do with the message listed below:20220208 021505.857 ERROR PET0 ESMF_Regrid.F90:366 ESMF_RegridStore Invalid argument - Internal subroutine call returned Error
20220208 021507.897 ERROR PET0 ESMF_FieldRegrid.F90:1415 ESMF_FieldRegridStoreNX Invalid argument - Internal subroutine call returned Error
20220208 021508.077 ERROR PET0 ESMF_Field_C.F90:1130 f_esmf_regridstore Invalid argument - Internal subroutine call returned Error
20220208 021543.915 INFO PET0 Finalizing ESMF

Any help in the interpretation or way forward of this error will be greatly appreciated. I have also tried other Python and unix regridding tools like xarray coarsen, pyresample, cdo, nctoolkit, block_reduce in skimage all either fail or do not give quite the result that I need.

Thanks
Jonathan

@nicrie
Copy link

nicrie commented Mar 13, 2022

same error message here when running

regridder = xe.Regridder(ds, ds_out, "bilinear")

where ds is a dask Dataset

@raphaeldussin
Copy link
Contributor

This version of the package is no longer maintained. Would you mind moving your issue to https://github.com/pangeo-data/xESMF?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants