CDO error :
Added by Alice Guccione 22 days ago
I am new to cdo and I am trying to compute the 95 percentile with timpctl over a list of 42 years of data. Firs I compute the minfile and maxfile like this:
cdo -b F32 -timmin -setrtomiss,0,0.099999999999 [ -cat /.../{1981..2022}/????????00/PREC_ACC_NC_*.nc ] minfile_WET_1981_2022_years.nc
cdo -b F32 -timmax -setrtomiss,0,0.099999999999 [ -cat /.../{1981..2022}/????????00/PREC_ACC_NC_*.nc ] maxfile_WET_1981_2022_years.nc
and then I compute the 95 percentile with:
cdo -b F32 -timpctl,95 -setrtomiss,0,0.099999999999 [ -cat /.../CHAPTER/{1981..2022}/????????00/PREC_ACC_NC_*.nc ] minfile_WET_1981_2022_years.nc maxfile_WET_1981_2022_years.nc perc95_WET_1981_2022_years.nc
This last line raises the error:
cdo: ../../../src/percentiles_hist.cc:218: double histGetBin(int, double, const T*) [with T = short unsigned int]: Assertion `i - 1 < nbins' failed.
/var/spool/slurmd/job64492/slurm_script: line 7: 1727709 Aborted (core dumped) cdo -b F32 -timpctl,95 -setrtomiss,0,0.099999999999 [ -cat /data/datasets/obs/CHAPTER/{1981..2022}/????????00/PREC_ACC_NC_*.nc ] minfile_WET_1981_2022_years.nc maxfile_WET_1981_2022_years.nc perc95_WET_1981_2022_years.nc
I don't understand why, since when I work with just the first 21 files or the second 21 files it works perfectly, for example the two lines below work perfectly:
cdo -b F32 -timpctl,95 -setrtomiss,0,0.099999999999 [ -cat /.../{1981..2001}/????????00/PREC_ACC_NC_*.nc ] minfile_WET_1981_2001_years.nc maxfile_WET_1981_2001_years.nc perc95_WET_1981_2001_years.nc
cdo -b F32 -timpctl,95 -setrtomiss,0,0.099999999999 [ -cat /.../{2002..2022}/????????00/PREC_ACC_NC_*.nc ] minfile_WET_2002_2022_years.nc maxfile_WET_2002_2022_years.nc perc95_WET_1_year_2002_2022.nc
Thanks in advance for the help!
Replies (3)
RE: CDO error : - Added by Ralf Mueller 8 days ago
hi Alice!
Can u try a different percentil with the complete list of files? I am not sure, how the histogram part of the algorithm works.
Another possible source of problem is the limited length of allowed command lines. Usually shells show proper error messages, when this limit is exceeded, but for whatever reason it might not work properly.
cheers
ralf
RE: CDO error with timpctl: - Added by Alice Guccione 8 days ago
Thanks Ralf,
I tried to run it with a different percentile and it gives me the same exaxt error:
cdo: ../../../src/percentiles_hist.cc:218: double histGetBin(int, double, const T*) [with T = short unsigned int]: Assertion `i - 1 < nbins' failed.
/var/spool/slurmd/job68169/slurm_script: line 10: 3262799 Aborted (core dumped)
As for the lenght of command lines, it shouldn't be a problem since with a shorter list of files it works perfectly with the same number of command lines. Maybe I am missing something, but I really can't see the problem... I don't think it is a memory problem because I would get a different error.
RE: CDO error with timpctl: - Added by Ralf Mueller 6 days ago
Alice Guccione wrote in RE: CDO error with timpctl: :
Thanks Ralf,
[ .. ]
As for the lenght of command lines, it shouldn't be a problem since with a shorter list of files it works perfectly with the same number of command lines. Maybe I am missing something, but I really can't see the problem... I don't think it is a memory problem because I would get a different error.
it's not about the number of command lines, it's about the length of a single line. But I dont think it is like causing the problem.
if the number of files is relevant though, can u check the minimum number of files, with which CDO fails?
Can u make the data available somewhere? how large are all input files combined?