Project

General

Profile

Error (cdf_put_vara_double)

Added by Gabe Bromley over 3 years ago

Hello,

I am running this command:

cdo -P 36 -z zip_4 -b F64 remapcon,template.nc -setgrid,4km_grid.txt ${SIMULATION_NAME}.hourly.RAINNC.all.nc ${SIMULATION_NAME}.hourly.RAINNC.05degree.nc

And I am getting this error:

cdo(1) setgrid: Process started
cdo remapcon: YAC first order conservative weights from curvilinear (795x495) to lonlat (480x300) grid
Error (cdf_put_vara_double): NetCDF: HDF error
cdf_put_vara_double: name=ACCUM_RAINNC type=NC_DOUBLE minval=0.000000 maxval=1.220517

If I select only a few time steps (up to a few thousand), it succeeds. I attached the first 10 time steps, and the remapped file of these 10 time steps. The full file fails. The file to be remapped is 39GB, there aren't any disk space issues. I have remapped files this big in the past, not sure why its a problem now. Let me know if you need any other info.

Thanks!

Gabe

subset.nc (19.5 MB) subset.nc Subset of ${SIMULATION_NAME}.hourly.RAINNC.all.nc
test_remap.nc (4.59 MB) test_remap.nc Successful remap of subset.nc

Replies (2)

RE: Error (cdf_put_vara_double) - Added by Gabe Bromley over 3 years ago

I tried to get around this issue by operating on smaller files (only 750) time steps and this error seems to occur at random. I will run a command and it will fail, but if I just re-run the command, it might succeed. Again no disk space issues, and these new files are now small enough to fit in memory easily. Here is the versioning information, any ideas?

Climate Data Operators version 1.9.7.1 (http://mpimet.mpg.de/cdo)
System: x86_64-pc-linux-gnu
CXX Compiler: /glade/u/apps/ch/opt/ncarcompilers/0.5.0/gnu/8.3.0/g++ -fPIC -fopenmp
CXX version : unknown
C Compiler: gcc -fPIC -fopenmp
C version : gcc (GCC) 8.3.0
F77 Compiler: gfortran -fPIC
F77 version : GNU Fortran (GCC) 8.3.0
Features: 251GB 72threads C++14 Fortran DATA PTHREADS OpenMP45 HDF5 NC4/HDF5 OPeNDAP SZ PROJ.4 SSE2
Libraries: HDF5/1.10.5 proj/5.2
Filetypes: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5
CDI library version : 1.9.7.1
cgribex library version : 1.9.3
ecCodes library version : 2.12.5
NetCDF library version : 4.6.3 of Jul 5 2019 11:25:22 $
hdf5 library version : 1.10.5
exse library version : 1.4.1
FILE library version : 1.8.3

RE: Error (cdf_put_vara_double) - Added by Ralf Mueller over 3 years ago

hi Gabe!

I think to reproduce the call the target grid (template.nc) is also needed. can you upload or at least describe it?

cheers
ralf

    (1-2/2)