Project

General

Profile

remapcon never completing

Added by Brendan DeTracey about 2 years ago

Hi all!
cdo 2.0.3 Linux Anaconda
I am trying to run remapcon on a netcdf subset of gridded ETOPO1 data. My command is:

$ cdo -v -b F32 remapcon,cdo_scrip_grid_nwa-gt-600.nc -expr,"etopo1_depth = (Band1 <= 0)  ? abs(Band1) : missval(Band1)" etopo1_nwa.nc etopo1_ocean_depth_nwa-gt-600.nc
 OpenMP:  num_procs=24  max_threads=1
.
.
.
the operation creates the target netcdf file, creates the coordinate variables and fills them with zeros, and then hangs. It does not create the new variable etopo1_depth
$ ncdump etopo1_ocean_depth_nwa-gt-600.nc 
netcdf etopo1_ocean_depth_nwa-gt-600_00000 {
dimensions:
    ncells = 1 ;
    vertices = 566 ;
variables:
    double lon(ncells) ;
        lon:standard_name = "longitude" ;
        lon:long_name = "longitude" ;
        lon:units = "degrees" ;
        lon:bounds = "lon_bnds" ;
    double lon_bnds(ncells, vertices) ;
    double lat(ncells) ;
        lat:standard_name = "latitude" ;
        lat:long_name = "latitude" ;
        lat:units = "degrees" ;
        lat:bounds = "lat_bnds" ;
    double lat_bnds(ncells, vertices) ;

// global attributes:
        :CDI = "Climate Data Interface version 2.0.3 (https://mpimet.mpg.de/cdi)" ;
        :Conventions = "CF-1.6" ;
data:

 lon = 0 ;

 lon_bnds =
  0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ;

 lat = 0 ;

 lat_bnds =
  0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 
    0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 ;
}

The nwa-gt-600 is yet another of my attempted abuses of cdo. It is a polygon enclosing depths greater than 600m in the Northwest Atlantic. I have used single unstructured grids to create time series for arbitrary simple closed polygons using remapcon and gencon. It is a wonderful application of cdo.


Replies (3)

RE: remapcon never completing - Added by Brendan DeTracey about 2 years ago

And the -v flag is no longer dumping verbose output from the above command. cdo 1.9.9 would dump the following output (and then hang):

$ cdo -v -b F32 remapcon,cdo_scrip_grid_nwa-gt-600.nc -expr,"etopo1_depth = (Band1 <= 0)  ? abs(Band1) : missval(Band1)" etopo1_nwa.nc etopo1_ocean_depth_nwa-gt-600.nc
 OpenMP:  num_procs=24  max_threads=1
cdo(1) expr: Process started
cdo    remapcon: Point search radius = 180 deg
cdo    remapcon: Extrapolation disabled!
cdo(1) expr: etopo1_depth = (Band1 <= 0)  ? abs(Band1) : missval(Band1);
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     init    func    missval (Band1)
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     init    func    abs (Band1)
cdo(1) expr:     push    const    0
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     init    arith    _tmp_[L1][N14641200] = Band1 <= 0
cdo(1) expr:     init    ifelse    _tmp_[L1][N14641200] ? _tmp_[L1][N14641200] : -32767
cdo(1) expr:     pop    var    etopo1_depth[L1][N14641200]
cdo(1) expr: Needed var: 0 Band1
cdo(1) expr: var: 0 Band1 ngp=14641200 nlev=1 coord= 
cdo(1) expr: var: 1 _ts ngp=10 nlev=1 coord= 
cdo(1) expr: var: 2 etopo1_depth ngp=14641200 nlev=1 coord= 
needed: 0 Band1
cdo(1) expr: vlistNvars(vlistID1)=1, vlistNvars(vlistID2)=1
#
# vlistID 32
#
nvars    : 1
ngrids   : 1
nzaxis   : 1
nsubtypes: 0
taxisID  : 29
instID   : -1
modelID  : -1
tableID  : -1
 varID param    gridID zaxisID stypeID tsteptype flag iorank name     longname         units
     0 -1           27      28      -1       1      0     -1 etopo1_depth  []

 varID  levID fvarID flevID mvarID mlevID  index  dtype  flag  level
     0      0      0      0      0      0     -1     -1     0  0

 varID  size iorank
  0 14641200     -1
cdo    remapcon: Set max_remaps to 2
cdo    remapcon: Normalization option: frac
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     expr    func    missval (Band1)
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     expr    func    abs (Band1)
cdo(1) expr:     push    const    0
cdo(1) expr:     push    var    Band1[L1][N14641200]
cdo(1) expr:     expr    arith    _tmp_[L1][N14641200] = Band1 <= 0
cdo(1) expr:     expr    ifelse    _tmp_[L1][N14641200] ? _tmp_[L1][N14641200] : -32767
cdo(1) expr:     pop    var    etopo1_depth[L1][N14641200]
cdo(1) expr:     expr    copy    etopo1_depth[L1][N14641200] = _tmp_[L1][N14641200]
cdo    remapcon: Cell search created: 0.00 seconds
cdo    remapcon: YAC first order conservative weights from lonlat (4980x2940) to unstructured (1) grid, with source mask (8615880)
cdo    remapcon: Called remapConservWeights()

RE: remapcon never completing - Added by Brendan DeTracey about 2 years ago

I never get tired of being wrong. Lucky me. Please disregard this thread, minus the comment about being verbose. 1.9.9 did eventually finish the remap. Time for a faster computer, I suppose.

RE: remapcon never completing - Added by Ralf Mueller about 2 years ago

nice - you can buy me a beer for providing a reason to get a new toy ;-)

hope u r good

cheers
ralf

    (1-3/3)