Project

General

Profile

Random error message with sellonlatbox

Added by Pauline Millet almost 2 years ago

Hello there,

I'm having some troubles with the command sellonlatbox recently. We sometimes have an error message on our remote server when using it, but it looks quite random to me. Last time it occurs, it was with the following command:

cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,1/31 -selmon,1 infile.nc -selmon,2/11 infile.nc -selday,1/31 -selmon,12 infile.nc outfile.nc

and the error message is always:

cdo    sellonlatbox (Abort): Longitudinal dimension is too small!

When we my colleague and I try to reproduce the error on our computers, with the exact same input and the exact same command, we don't have any problem.
We always use sellonlatbox with a 0.1° of delta between lon_min and lon_max, latmin and lat_max. Cells in the input file are 0.11° large.

Another thing to consider, the command is launched in the same environment since we use the same docker image than the one on the remote server.

Have you any clue on what is going on here?

The infile.nc is available here if needed: https://seafile.makina-corpus.net:443/f/6cf28222571949798a7b/?dl=1

Thanks,
Pauline


Replies (12)

RE: Random error message with sellonlatbox - Added by Estanislao Gavilan almost 2 years ago

Hi Pauline,

I tried to run that command, but it says "cdo sellonlatbox (Abort): Too many streams! Operator needs 1 input and 1 output streams" (in Cygwing64). So I deleted everything except for the years.

cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 infile.nc outfile.nc

This command runs without any problem. I find it difficult to understand your command. Correct me if I am wrong, but you want to do this

1) You want to select the month of December and then the days from 1 to 31.

2) You open the file again and select the months of February to November

3) You open file, select the month of January, and then the days from 1/31

4) You merge the selections 1), 2) and 3); select the years 1985 to 2050; and finnally, you use the box.

Why do you do 1,2 and 3? I mean, you are not performing means or sums. selyear (as well as selmon) will include every time step between that threshold.

Kind regards,

Estanislao

RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago

Hi Estanislao,

Thanks for your reply.

Yes you're right in the process we'd like to apply. This command can seem a bit stupid, it's actually the first part of a generic process. We first select in our input file what we are interested in and then we apply mean, sum, etc.
The command could be to select from March 4th to June 17th, on all years from 1985 to 2050, and would look like:

cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,4/31 -selmon,3 infile.nc -selmon,4/5 infile.nc -selday,1/17 -selmon,6 infile.nc outfile.nc

Cheers,
Pauline

RE: Random error message with sellonlatbox - Added by Estanislao Gavilan almost 2 years ago

Hi Pauline,

Have you tried to contact the IT service of that cluster?If both machines use the same cdo version, you should observe same results. Maybe some nodes were malfunctioning or the cluster is killing your job because it requires a lot of memory.

RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago

Hi Estanislao,
Yes we did, but they didn't notice anything wrong. We keep investigating...
Cheers,
Pauline

RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago

Hi!

I checked this command with your input under cygwin with cdo-2.0.5

cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 -selyear,1985/2050 -mergetime -selday,4/31 -selmon,3 infile.nc -selmon,4/5 infile.nc -selday,1/17 -selmon,6 infile.nc outfile.nc

it worked out of the box

same for cdo-2.1.0 under linux.

@Pauline: Which CDO version do you use?

cheers
ralf

RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago

Hello Ralf,
I'm using CDO 2.0.4, under Linux.
Cheers,
Pauline

RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago

hm, my tests with 2.0.5 are running fine,too. I will test with 2.0.4 as soon as the build is ready, but I don't expert it to fail

and the error is

cdo    sellonlatbox (Abort): Longitudinal dimension is too small!

OR
cdo sellonlatbox (Abort): Too many streams! Operator needs 1 input and 1 output streams

And can you post the output of

cdo -V
please?

RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago

The error we obtained was

cdo    sellonlatbox (Abort): Longitudinal dimension is too small!

Here is the output of cdo -V:

Climate Data Operators version 2.0.4 (https://mpimet.mpg.de/cdo)
System: x86_64-pc-linux-gnu
CXX Compiler: g++ -std=gnu++14 -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -fopenmp -pthread
CXX version : g++ (Ubuntu 11.2.0-16ubuntu1) 11.2.0
C Compiler: gcc -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wall -pedantic -fPIC  -fopenmp -pthread -pthread
C version : gcc (Ubuntu 11.2.0-16ubuntu1) 11.2.0
F77 Compiler: f77 -g -O2 -ffile-prefix-map=/build/cdo-hTyRvi/cdo-2.0.4=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong
F77 version : GNU Fortran (Ubuntu 11.2.0-16ubuntu1) 11.2.0
Features: 23GB 8threads C++14 OpenMP45 Fortran PTHREADS HDF5 NC4/HDF5/threadsafe OPeNDAP SZ UDUNITS2 PROJ MAGICS CURL FFTW3 SSE2
Libraries: HDF5/1.10.7 proj/8.2.1 curl/7.81.0 magics/4.10.1
CDI data types: SizeType=size_t  DateType=int64_t
CDI file types: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5 
     CDI library version : 2.0.4
 ecCodes library version : 2.24.2
  NetCDF library version : 4.8.1 of Sep 29 2021 09:36:14 $
    hdf5 library version : library undefined
    exse library version : 1.4.2
    FILE library version : 1.9.1

RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago

First things first: Can you update your version to 2.1? If you are on linux, conda might be the easiest option to do it

RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago

Does the error ocurr, if you use

cdo -sellonlatbox,-1.4650047302246094,-1.3650047302246093,47.17501915944666,47.27501915944666 infile.nc ofile.nc
or only with the exact commandline include mergetime,selmon and so on ?

RE: Random error message with sellonlatbox - Added by Pauline Millet almost 2 years ago

Hello all,

The command was also getting the error without mergetime etc. ... After deeper investigation, it appears that the infile was corrupted on our remote server...
Sorry for the trouble!

Cheers,
Pauline

RE: Random error message with sellonlatbox - Added by Ralf Mueller almost 2 years ago

hi Pauline,

never mind - things happen ;-)

have a nice week!

cheers
ralf

    (1-12/12)