'cdo merge': ECCODES ERROR with key "scaledValueOfSecondFixedSurface" for number of input files > 29

Added by Maik Gottschalk over 3 years ago

Hi there!

using 'cdo merge' on cygwin (Windows 10, 64 bit) I obtained the following error, if the number of input files exceeds 29:

$ cdo -f grb2 merge *.grib2 all.grib2
ECCODES ERROR : Key "scaledValueOfSecondFixedSurface": Trying to encode a negative value of -9223372036854775808 for key of type unsigned

ECCODES ERROR : unable to set scaledValueOfSecondFixedSurface=-9223372036854775808 as long (Encoding invalid)
!!! failed call to grib_set_long( grib_handle* h, "bottomLevel", -9223372036854775808) !!!
stream_gribapi.c at line 2578: my_grib_set_long(gh, "bottomLevel", (long) dlevel2) failed: Encoding invalid

'*.grib2' consists of GRIB2 data files from 'https://opendata.dwd.de/weather/nwp/icon-eu/grib/12/p/'.
If the number of input files is <= 29, 'cdo merge' performs successfully!

Further info:
$ cdo -V
Climate Data Operators version 1.9.8 (https://mpimet.mpg.de/cdo)
System: x86_64-unknown-cygwin
...

$ ulimit -n
300

Is this behaviour a bug or intended?

A further hint:
In addition to the error described above the first execution of 'cdo merge' produced the following error (same environment as above):

$ cdo merge *.grib2 all.grib2
ECCODES ERROR : Unable to load sample file GRIB2.tmpl
in /usr/local/share/eccodes/samples

Error (gribHandleNew): grib_handle_new_from_samples failed!

This error can be avoided by creating a soft link in /usr/local/share/ to the 'eccodes' sources.
Mayby this info should be added to 'https://code.mpimet.mpg.de/projects/cdo/wiki/Win32'?

Thanks for your great tool and regards from KN to HH,

Maik.

Replies (4)

RE: 'cdo merge': ECCODES ERROR with key "scaledValueOfSecondFixedSurface" for number of input files > 29 - Added by Ralf Mueller over 3 years ago

hi Maik!

I cannot reproduce this error: merge works, but the resulting file cannot be processed by cdo anymore. Can you check the Linux subsystem with cdo?

RE: 'cdo merge': ECCODES ERROR with key "scaledValueOfSecondFixedSurface" for number of input files > 29 - Added by Maik Gottschalk over 3 years ago

Dear Ralf,

as I don't have the Linux subsystem installed, I just tried 'cdo merge' using a VM-based Lubuntu/64 bit.
There 'cdo merge' works flawlessly with at least 60 files, but is based upcon cdo v1.9.9rc4:

$ cdo -V
Climate Data Operators version 1.9.9rc4 (https://mpimet.mpg.de/cdo)
System: x86_64-pc-linux-gnu
CXX Compiler: g++ -g -O2 -fopenmp -pthread
CXX version : g++ (Ubuntu 9.3.0-10ubuntu2) 9.3.0
C Compiler: gcc -g -O2 -fopenmp -pthread -pthread
C version : gcc (Ubuntu 9.3.0-10ubuntu2) 9.3.0
F77 Compiler: f77 -g -O2
F77 version : GNU Fortran (Ubuntu 9.3.0-10ubuntu2) 9.3.0
Features: 3GB 4threads C++14 OpenMP45 Fortran PTHREADS HDF5 NC4/HDF5/threadsafe OPeNDAP SZ PROJ XML2 MAGICS CURL FFTW3 SSE2
Libraries: HDF5/1.10.4 proj/6.3.1 xml2/2.9.10 curl/7.68.0
Filetypes: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5
CDI library version : 1.9.9rc4
cgribex library version : 1.9.5
ecCodes library version : 2.16.0
NetCDF library version : 4.7.3 of Jan 23 2020 04:18:16 $
hdf5 library version : library undefined
exse library version : 1.4.1
FILE library version : 1.9.1

Thus, hopefully/probably, the 'merge'-error using cygwin is gone in the current development version.

Thanks,

Maik.

RE: 'cdo merge': ECCODES ERROR with key "scaledValueOfSecondFixedSurface" for number of input files > 29 - Added by Ralf Mueller over 3 years ago

on my linux box cdo-1.9.8 works without problems. here is a link on how to install it - just in case.

it is in fact nothing but an ubuntu VM with file-system integration, which comes with cdo as a precompiled cdo-1.9.3 read to be installed (sudo apt-install cdo)

in general cygwin is a bit hard to debug, because every user has a different update strategy on it: some never update, some do it regularly. unfortunately with the latest gcc in cygwin CDO produces a compiler error, so it's not possible to fix something at the moment.

cheers
ralf

RE: 'cdo merge': ECCODES ERROR with key "scaledValueOfSecondFixedSurface" for number of input files > 29 - Added by Micah Childs over 3 years ago

Ralf Mueller wrote:

on my linux box cdo-1.9.8 works without problems. here 8 ball pool is a link on how to install it - just in case.

it is in fact nothing but an ubuntu VM with file-system integration, which comes with cdo as a precompiled cdo-1.9.3 read to be installed (sudo apt-install cdo)

in general cygwin is a bit hard to debug, because every user has a different update strategy on it: some never update, some do it regularly. unfortunately with the latest gcc in cygwin CDO produces a compiler error, so it's not possible to fix something at the moment.

cheers
ralf

It works

Many thanks!

(1-4/4)

Project

General

Profile

CDO