INFO [219645] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [219645] Package versions INFO [219645] ---------------- INFO [219645] ESMValCore: 2.10.0.dev53+g69001686b INFO [219645] ESMValTool: 2.10.0.dev28+g6cdb51ff1 INFO [219645] ---------------- INFO [219645] Using config file /home/emr001/config_files/config-user-one.yml INFO [219645] Writing program log files to: /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/run/main_log.txt /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/run/main_log_debug.txt INFO [219645] Starting the Earth System Model Evaluation Tool at time: 2023-10-10 18:49:07 UTC INFO [219645] ---------------------------------------------------------------------- INFO [219645] RECIPE = /home/emr001/ESMValTool_orig/esmvaltool/recipes/recipe_test_sfcWind.yml INFO [219645] RUNDIR = /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/run INFO [219645] WORKDIR = /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/work INFO [219645] PREPROCDIR = /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/preproc INFO [219645] PLOTDIR = /space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/plots INFO [219645] ---------------------------------------------------------------------- INFO [219645] Running tasks using at most 1 processes INFO [219645] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [219645] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. WARNING [219645] Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. INFO [219645] Creating tasks from recipe INFO [219645] Creating tasks for diagnostic cmip6 INFO [219645] Creating preprocessor task cmip6/sfcWind INFO [219645] Creating preprocessor 'default' task for variable 'sfcWind' INFO [219645] Found input files for Dataset: sfcWind, 3hr, CMIP6, GFDL-CM4C192, HighResMIP, highresSST-future, r1i1p1f1, gr3, v20180701 INFO [219645] PreprocessingTask cmip6/sfcWind created. INFO [219645] These tasks will be executed: cmip6/sfcWind INFO [219645] Wrote recipe with version numbers and wildcards to: file:///space/hall5/sitestore/eccc/crd/ccrn/users/emr001/esmvaltool_output/recipe_test_sfcWind_20231010_184847/run/recipe_test_sfcWind_filled.yml INFO [219645] Using the Dask basic scheduler. INFO [219645] Running 1 tasks sequentially INFO [219645] Starting task cmip6/sfcWind in process [219645] WARNING [219645] Long name changed from 'Eastward Near-Surface Wind Speed' to 'Eastward Near-Surface Wind' (for file /space/hall5/sitestore/eccc/crd/crd_shared/ESGF_downloads/CMIP6/HighResMIP/NOAA-GFDL/GFDL-CM4C192/highresSST-future/r1i1p1f1/3hr/uas/gr3/v20180701/uas_3hr_GFDL-CM4C192_highresSST-future_r1i1p1f1_gr3_201501010300-203501010000.nc) WARNING [219645] Long name changed from 'Northward Near-Surface Wind Speed' to 'Northward Near-Surface Wind' (for file /space/hall5/sitestore/eccc/crd/crd_shared/ESGF_downloads/CMIP6/HighResMIP/NOAA-GFDL/GFDL-CM4C192/highresSST-future/r1i1p1f1/3hr/vas/gr3/v20180701/vas_3hr_GFDL-CM4C192_highresSST-future_r1i1p1f1_gr3_201501010300-203501010000.nc) ERROR [219645] Failed to run preprocessor function 'derive' on the data [, ] loaded from original input file(s) [LocalFile('/space/hall5/sitestore/eccc/crd/crd_shared/ESGF_downloads/CMIP6/HighResMIP/NOAA-GFDL/GFDL-CM4C192/highresSST-future/r1i1p1f1/3hr/uas/gr3/v20180701/uas_3hr_GFDL-CM4C192_highresSST-future_r1i1p1f1_gr3_201501010300-203501010000.nc'), LocalFile('/space/hall5/sitestore/eccc/crd/crd_shared/ESGF_downloads/CMIP6/HighResMIP/NOAA-GFDL/GFDL-CM4C192/highresSST-future/r1i1p1f1/3hr/vas/gr3/v20180701/vas_3hr_GFDL-CM4C192_highresSST-future_r1i1p1f1_gr3_201501010300-203501010000.nc')] with function argument(s) short_name = 'sfcWind', standard_name = 'wind_speed', long_name = 'Near-Surface Wind Speed', units = 'm s-1' INFO [219645] Maximum memory used (estimate): 0.7 GB INFO [219645] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [219645] Program terminated abnormally, see stack trace below for more information: Traceback (most recent call last): File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_main.py", line 530, in run fire.Fire(ESMValTool()) File "/space/hall5/sitestore/eccc/crd/ccrn/users/emr001/miniconda3/envs/dev_ecore_tool/lib/python3.11/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/space/hall5/sitestore/eccc/crd/ccrn/users/emr001/miniconda3/envs/dev_ecore_tool/lib/python3.11/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( ^^^^^^^^^^^^^^^^^^^^ File "/space/hall5/sitestore/eccc/crd/ccrn/users/emr001/miniconda3/envs/dev_ecore_tool/lib/python3.11/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^ File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_main.py", line 417, in run self._run(recipe, session) File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_main.py", line 459, in _run process_recipe(recipe_file=recipe, session=session) File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_main.py", line 130, in process_recipe recipe.run() File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_recipe/recipe.py", line 1074, in run self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks']) File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_task.py", line 736, in run self._run_sequential() File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_task.py", line 747, in _run_sequential task.run() File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/_task.py", line 264, in run self.output_files = self._run(input_files) ^^^^^^^^^^^^^^^^^^^^^^ File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/preprocessor/__init__.py", line 668, in _run product.apply(step, self.debug) File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/preprocessor/__init__.py", line 471, in apply self.cubes = preprocess(self.cubes, step, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/preprocessor/__init__.py", line 376, in preprocess result.append(_run_preproc_function(function, items, settings, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/preprocessor/__init__.py", line 325, in _run_preproc_function return function(items, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/fs/homeu2/eccc/crd/ccrn_shr/emr001/ESMValCore/esmvalcore/preprocessor/_derive/__init__.py", line 93, in derive DerivedVariable = ALL_DERIVED_VARIABLES[short_name.lower()] # noqa: N806 ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ KeyError: 'sfcwind' INFO [219645] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.