Random error message with sellonlatbox
Added by Pauline Millet almost 2 years ago
Hello there,
I'm having some troubles with the command sellonlatbox recently. We sometimes have an error message on our remote server when using it, but it looks quite random to me. Last time it occurs, it was with the following command:
cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,1/31 -selmon,1 infile.nc -selmon,2/11 infile.nc -selday,1/31 -selmon,12 infile.nc outfile.nc
and the error message is always:
cdo sellonlatbox (Abort): Longitudinal dimension is too small!
When we my colleague and I try to reproduce the error on our computers, with the exact same input and the exact same command, we don't have any problem.
We always use sellonlatbox with a 0.1° of delta between lon_min and lon_max, latmin and lat_max. Cells in the input file are 0.11° large.
Another thing to consider, the command is launched in the same environment since we use the same docker image than the one on the remote server.
Have you any clue on what is going on here?
The infile.nc is available here if needed: https://seafile.makina-corpus.net:443/f/6cf28222571949798a7b/?dl=1
Thanks,
Pauline
Replies (12)
RE: Random error message with sellonlatbox - Added by Estanislao Gavilan almost 2 years ago
Hi Pauline,
I tried to run that command, but it says "cdo sellonlatbox (Abort): Too many streams! Operator needs 1 input and 1 output streams" (in Cygwing64). So I deleted everything except for the years.
cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 infile.nc outfile.nc
This command runs without any problem. I find it difficult to understand your command. Correct me if I am wrong, but you want to do this
1) You want to select the month of December and then the days from 1 to 31.
2) You open the file again and select the months of February to November
3) You open file, select the month of January, and then the days from 1/31
4) You merge the selections 1), 2) and 3); select the years 1985 to 2050; and finnally, you use the box.
Why do you do 1,2 and 3? I mean, you are not performing means or sums. selyear (as well as selmon) will include every time step between that threshold.
Kind regards,
Estanislao
RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago
Hi Estanislao,
Thanks for your reply.
Yes you're right in the process we'd like to apply. This command can seem a bit stupid, it's actually the first part of a generic process. We first select in our input file what we are interested in and then we apply mean, sum, etc.
The command could be to select from March 4th to June 17th, on all years from 1985 to 2050, and would look like:
cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,4/31 -selmon,3 infile.nc -selmon,4/5 infile.nc -selday,1/17 -selmon,6 infile.nc outfile.nc
Cheers,
Pauline
RE: Random error message with sellonlatbox - Added by Estanislao Gavilan almost 2 years ago
Hi Pauline,
Have you tried to contact the IT service of that cluster?If both machines use the same cdo version, you should observe same results. Maybe some nodes were malfunctioning or the cluster is killing your job because it requires a lot of memory.
RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago
Hi Estanislao,
Yes we did, but they didn't notice anything wrong. We keep investigating...
Cheers,
Pauline
RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago
Hi!
I checked this command with your input under cygwin with cdo-2.0.5
cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,4/31 -selmon,3 infile.nc -selmon,4/5 infile.nc -selday,1/17 -selmon,6 infile.nc outfile.nc
it worked out of the box
same for cdo-2.1.0 under linux.
@Pauline: Which CDO version do you use?
cheers
ralf
RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago
Hello Ralf,
I'm using CDO 2.0.4, under Linux.
Cheers,
Pauline
RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago
hm, my tests with 2.0.5 are running fine,too. I will test with 2.0.4 as soon as the build is ready, but I don't expert it to fail
and the error is
cdo sellonlatbox (Abort): Longitudinal dimension is too small!
OR
cdo sellonlatbox (Abort): Too many streams! Operator needs 1 input and 1 output streams
And can you post the output of
cdo -Vplease?
RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago
The error we obtained was
cdo sellonlatbox (Abort): Longitudinal dimension is too small!
Here is the output of cdo -V:
Climate Data Operators version 2.0.4 (https://mpimet.mpg.de/cdo) System: x86_64-pc-linux-gnu CXX Compiler: g++ -std=gnu++14 -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -fopenmp -pthread CXX version : g++ (Ubuntu 11.2.0-16ubuntu1) 11.2.0 C Compiler: gcc -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wall -pedantic -fPIC -fopenmp -pthread -pthread C version : gcc (Ubuntu 11.2.0-16ubuntu1) 11.2.0 F77 Compiler: f77 -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong F77 version : GNU Fortran (Ubuntu 11.2.0-16ubuntu1) 11.2.0 Features: 23GB 8threads C++14 OpenMP45 Fortran PTHREADS HDF5 NC4/HDF5/threadsafe OPeNDAP SZ UDUNITS2 PROJ MAGICS CURL FFTW3 SSE2 Libraries: HDF5/1.10.7 proj/8.2.1 curl/7.81.0 magics/4.10.1 CDI data types: SizeType=size_t DateType=int64_t CDI file types: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5 CDI library version : 2.0.4 ecCodes library version : 2.24.2 NetCDF library version : 4.8.1 of Sep 29 2021 09:36:14 $ hdf5 library version : library undefined exse library version : 1.4.2 FILE library version : 1.9.1
RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago
First things first: Can you update your version to 2.1? If you are on linux, conda might be the easiest option to do it
RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago
Does the error ocurr, if you use
cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 infile.nc ofile.ncor only with the exact commandline include mergetime,selmon and so on ?
RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago
Hello all,
The command was also getting the error without mergetime etc. ... After deeper investigation, it appears that the infile was corrupted on our remote server...
Sorry for the trouble!
Cheers,
Pauline
RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago
hi Pauline,
never mind - things happen ;-)
have a nice week!
cheers
ralf