having trouble using opendap with CDO
Added by Don Murray over 5 years ago
Hi-
I'm trying to use cdo with OPeNDAP URLs, but keep getting an error that the file doesn't exist:
dmurray% cdo sinfo https://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/cpc_global_precip/precip.1979.nc test.out
cdo (Abort): Input file https://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/cpc_global_precip/precip.1979.nc of process sinfo does not exists
I'm using the Macports version of CDO and cdo -V produces:
dmurray% cdo -V
Climate Data Operators version 1.9.5 (http://mpimet.mpg.de/cdo)
System: x86_64-apple-darwin17.7.0
CXX Compiler: /usr/bin/clang++ -std=gnu++11 -pipe -Os -stdlib=libc++ -arch x86_64 -D_THREAD_SAFE -pthread
CXX version : unknown
C Compiler: /usr/bin/clang -pipe -Os -arch x86_64 -D_THREAD_SAFE -pthread -D_THREAD_SAFE -D_THREAD_SAFE -pthread
C version : unknown
F77 Compiler: gfortran -pipe -Os
F77 version : GNU Fortran (MacPorts gcc7 7.3.0_3) 7.3.0
Features: 32GB 4threads C++11 Fortran DATA PTHREADS HDF5 NC4/HDF5 OPeNDAP UDUNITS2 PROJ.4 CURL FFTW3 SSE4_1
Libraries: HDF5/1.10.2 proj/5.1 curl/7.61.0
Filetypes: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5
CDI library version : 1.9.5
GRIB_API library version : 2.8.2
NetCDF library version : 4.6.1 of Aug 12 2018 14:29:06 $
HDF5 library version : 1.10.2
EXSE library version : 1.4.0
FILE library version : 1.8.3which I read as having OPeNDAP supported since it's lited in the Features.
I can use ncdump on the same URL:
ncdump -h https://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/cpc_global_precip/precip.1979.nc
netcdf precip.1979 {
dimensions:
time = UNLIMITED ; // (365 currently)
lat = 360 ;
lon = 720 ;
variables:
float lon(lon) ;
lon:long_name = "Longitude" ;
lon:units = "degrees_east" ;
lon:axis = "X" ;
lon:standard_name = "longitude" ;
lon:actual_range = 0.25f, 359.75f ;
lon:coordinate_defines = "center" ;
float lat(lat) ;
lat:actual_range = 89.75f, -89.75f ;
lat:long_name = "Latitude" ;
lat:units = "degrees_north" ;
lat:axis = "Y" ;
lat:standard_name = "latitude" ;
lat:coordinate_defines = "center" ;
double time(time) ;
time:long_name = "Time" ;
time:axis = "T" ;
time:standard_name = "time" ;
time:coordinate_defines = "start" ;
time:actual_range = 692496., 701232. ;
time:delta_t = "0000-00-01 00:00:00" ;
time:avg_period = "0000-00-01 00:00:00" ;
time:units = "hours since 1900-01-01 00:00:00" ;
time:_ChunkSizes = 1 ;
float precip(time, lat, lon) ;
precip:missing_value = -9.96921e+36f ;
precip:var_desc = "Precipitation" ;
precip:level_desc = "Surface" ;
precip:statistic = "Total" ;
precip:parent_stat = "Other" ;
precip:long_name = "Daily total of precipitation" ;
precip:cell_methods = "time: sum" ;
precip:avg_period = "0000-00-01 00:00:00" ;
precip:actual_range = 0.f, 428.0242f ;
precip:units = "mm" ;
precip:valid_range = 0.f, 1000.f ;
precip:dataset = "CPC Global Precipitation" ;
precip:_ChunkSizes = 1, 360, 720 ;
// global attributes:
:Conventions = "CF-1.0" ;
:version = "V1.0" ;
:history = "created 9/2016 by CAS NOAA/ESRL PSD" ;
:title = "CPC GLOBAL PRCP V1.0" ;
:References = "https://www.esrl.noaa.gov/psd/data/gridded/data.cpc.globalprecip.html" ;
:Source = "ftp://ftp.cpc.ncep.noaa.gov/precip/CPC_UNI_PRCP/" ;
:dataset_title = "CPC GLOBAL PRCP V1.0" ;
:DODS_EXTRA.Unlimited_Dimension = "time" ;
}
so I know it's a valid URL.
Thanks for any help you can provide.
Don Murray
Replies (3)
RE: having trouble using opendap with CDO - Added by Don Murray over 5 years ago
This does work on a different machine using an older version of CDO (1.8.2):
[dmurray@linux128 ~]$ cdo -V
Climate Data Operators version 1.8.2 (http://mpimet.mpg.de/cdo)
Compiled: by root on linux256.psd.ad (x86_64-unknown-linux-gnu) May 22 2017 10:56:16
Compiler: gcc -fopenmp
version: gcc (GCC) 6.3.0
Features: DATA PTHREADS OpenMP45 HDF5 NC4/HDF5 OPeNDAP SSE2
Libraries: HDF5/1.10.1
Filetypes: srv ext ieg grb1 nc1 nc2 nc4 nc4c
CDI library version : 1.8.2 of May 22 2017 10:55:34
CGRIBEX library version : 1.7.6 of Dec 20 2016 19:55:24
NetCDF library version : 4.4.1.1 of May 22 2017 10:44:13 $
HDF5 library version : 1.10.1
SERVICE library version : 1.4.0 of May 22 2017 10:55:23
EXTRA library version : 1.4.0 of May 22 2017 10:55:19
IEG library version : 1.4.0 of May 22 2017 10:55:21
FILE library version : 1.8.3 of May 22 2017 10:55:19
but not on another similar linux system that was just upgraded to 1.9.5 built locally:
[dmurray@linux256 ~]$ cdo -V
Climate Data Operators version 1.9.5 (http://mpimet.mpg.de/cdo)
System: x86_64-pc-linux-gnu
CXX Compiler: g++ -g -O2 -fopenmp
CXX version : g++ (GCC) 7.3.0
C Compiler: gcc -m64 -fopenmp
C version : gcc (GCC) 7.3.0
F77 Compiler: pgf77 -g
F77 version : pgf77 17.10-0 64-bit target on x86-64 Linux -tp sandybridge
Features: 236GB 24threads C++14 DATA PTHREADS OpenMP45 HDF5 NC4/HDF5 OPeNDAP SSE2
Libraries: HDF5/1.10.2
Filetypes: srv ext ieg grb1 grb2 nc1 nc2 nc4 nc4c nc5
CDI library version : 1.9.5
CGRIBEX library version : 1.9.1
GRIB_API library version : 2.8.2
NetCDF library version : 4.6.1 of May 18 2018 13:03:50 $
HDF5 library version : 1.10.2
EXSE library version : 1.4.0
FILE library version : 1.8.3
On 1.8.2, I get:
[dmurray@linux128 ~]$ cdo sinfo https://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/cpc_global_precip/precip.1979.nc
File format : NetCDF
-1 : Institut Source Steptype Levels Num Points Num Dtype : Parameter ID
1 : unknown unknown instant 1 1 259200 1 F32 : -1
Grid coordinates :
1 : lonlat : points=259200 (720x360)
lon : 0.25 to 359.75 by 0.5 degrees_east circular
lat : 89.75 to -89.75 by -0.5 degrees_north
Vertical coordinates :
1 : surface : levels=1
Time coordinate : 365 steps
RefTime = 1900-01-01 00:00:00 Units = hours Calendar = standard
YYYY-MM-DD hh:mm:ss YYYY-MM-DD hh:mm:ss YYYY-MM-DD hh:mm:ss YYYY-MM-DD hh:mm:ss
1979-01-01 00:00:00 1979-01-02 00:00:00 1979-01-03 00:00:00 1979-01-04 00:00:00
1979-01-05 00:00:00 1979-01-06 00:00:00 1979-01-07 00:00:00 1979-01-08 00:00:00
1979-01-09 00:00:00 1979-01-10 00:00:00 1979-01-11 00:00:00 1979-01-12 00:00:00
1979-01-13 00:00:00 1979-01-14 00:00:00 1979-01-15 00:00:00 1979-01-16 00:00:00
1979-01-17 00:00:00 1979-01-18 00:00:00 1979-01-19 00:00:00 1979-01-20 00:00:00
1979-01-21 00:00:00 1979-01-22 00:00:00 1979-01-23 00:00:00 1979-01-24 00:00:00
1979-01-25 00:00:00 1979-01-26 00:00:00 1979-01-27 00:00:00 1979-01-28 00:00:00
1979-01-29 00:00:00 1979-01-30 00:00:00 1979-01-31 00:00:00 1979-02-01 00:00:00
1979-02-02 00:00:00 1979-02-03 00:00:00 1979-02-04 00:00:00 1979-02-05 00:00:00
1979-02-06 00:00:00 1979-02-07 00:00:00 1979-02-08 00:00:00 1979-02-09 00:00:00
1979-02-10 00:00:00 1979-02-11 00:00:00 1979-02-12 00:00:00 1979-02-13 00:00:00
1979-02-14 00:00:00 1979-02-15 00:00:00 1979-02-16 00:00:00 1979-02-17 00:00:00
1979-02-18 00:00:00 1979-02-19 00:00:00 1979-02-20 00:00:00 1979-02-21 00:00:00
1979-02-22 00:00:00 1979-02-23 00:00:00 1979-02-24 00:00:00 1979-02-25 00:00:00
1979-02-26 00:00:00 1979-02-27 00:00:00 1979-02-28 00:00:00 1979-03-01 00:00:00
................................................................................
.................
1979-11-05 00:00:00 1979-11-06 00:00:00 1979-11-07 00:00:00 1979-11-08 00:00:00
1979-11-09 00:00:00 1979-11-10 00:00:00 1979-11-11 00:00:00 1979-11-12 00:00:00
1979-11-13 00:00:00 1979-11-14 00:00:00 1979-11-15 00:00:00 1979-11-16 00:00:00
1979-11-17 00:00:00 1979-11-18 00:00:00 1979-11-19 00:00:00 1979-11-20 00:00:00
1979-11-21 00:00:00 1979-11-22 00:00:00 1979-11-23 00:00:00 1979-11-24 00:00:00
1979-11-25 00:00:00 1979-11-26 00:00:00 1979-11-27 00:00:00 1979-11-28 00:00:00
1979-11-29 00:00:00 1979-11-30 00:00:00 1979-12-01 00:00:00 1979-12-02 00:00:00
1979-12-03 00:00:00 1979-12-04 00:00:00 1979-12-05 00:00:00 1979-12-06 00:00:00
1979-12-07 00:00:00 1979-12-08 00:00:00 1979-12-09 00:00:00 1979-12-10 00:00:00
1979-12-11 00:00:00 1979-12-12 00:00:00 1979-12-13 00:00:00 1979-12-14 00:00:00
1979-12-15 00:00:00 1979-12-16 00:00:00 1979-12-17 00:00:00 1979-12-18 00:00:00
1979-12-19 00:00:00 1979-12-20 00:00:00 1979-12-21 00:00:00 1979-12-22 00:00:00
1979-12-23 00:00:00 1979-12-24 00:00:00 1979-12-25 00:00:00 1979-12-26 00:00:00
1979-12-27 00:00:00 1979-12-28 00:00:00 1979-12-29 00:00:00 1979-12-30 00:00:00
1979-12-31 00:00:00
cdo sinfo: Processed 1 variable over 365 timesteps ( 0.09s )
Hope this extra info help.
Don
RE: having trouble using opendap with CDO - Added by Oliver Heidmann over 5 years ago
Hello Don,
this is not intended. We are restructuring a lot in CDO right now and we removed this on accident.
We found the problem and it will be fixed in our next release.
Thanks for reporting this.
Greetings
Oliver
RE: having trouble using opendap with CDO - Added by Don Murray over 5 years ago
Hi Oliver-
Ah, the law of unintended consequences strikes again. Glad it's not just user error. 
Thanks for fixing this issue. I look forward to the new release.
Don