Project

General

Profile

CDO fails for ESGF opendap urls

Added by David Rayner almost 10 years ago

Hi,

I'd love to use CDO to access ESGF. But no joy.

I believe I have the credentials sorted. my .dodsrc has:

CURL.VERBOSE=1
CURL.COOKIEJAR=/Users/xrayda/.esg/.dods_cookies
CURL.SSL.VALIDATE=0
CURL.SSL.CERTIFICATE=/Users/xrayda/.esg/credentials.pem
CURL.SSL.KEY=/Users/xrayda/.esg/credentials.pem
CURL.SSL.CAPATH=/Users/xrayda/.esg/certificates
HTTP.VERBOSE=1
HTTP.COOKIEJAR=/Users/xrayda/.esg/.dods_cookies
HTTP.SSL.VALIDATE=
HTTP.SSL.CERTIFICATE=/Users/xrayda/.esg/credentials.pem
HTTP.SSL.KEY=/Users/xrayda/.esg/credentials.pem
HTTP.SSL.CAPATH=/Users/xrayda/.esg/certificates

and I have a valid credentials.pem and ncdump work fine: (example below without verbose!)

$ ncdump -h https://cmip3.dkrz.de/thredds/dodsC/cmip5/output1/CCCma/CanESM2/historical/day/atmos/day/r1i1p1/v20120410/pr/pr_day_CanESM2_historical_r1i1p1_18500101-20051231.nc
netcdf pr_day_CanESM2_historical_r1i1p1_18500101-20051231 {
dimensions:
time = UNLIMITED ; // (56940 currently)
bnds = 2 ;
lat = 64 ;
lon = 128 ;
variables:
double time(time) ;
time:bounds = "time_bnds" ;
time:units = "days since 1850-1-1" ;
....

But try to access the same dataset with cdo gives:

$ cdo sinfo https://cmip3.dkrz.de/thredds/dodsC/cmip5/output1/CCCma/CanESM2/historical/day/atmos/day/r1i1p1/v20120410/pr/pr_day_CanESM2_historical_r1i1p1_18500101-20051231.nc
  • Adding handle: conn: 0x7fb650803e00
  • Adding handle: send: 0
  • Adding handle: recv: 0
  • Curl_addHandleToPipeline: length: 1
  • - Conn 0 (0x7fb650803e00) send_pipe: 1, recv_pipe: 0
  • About to connect() to cmip3.dkrz.de port 443 (#0)
  • Trying 136.172.30.62...
  • Connected to cmip3.dkrz.de (136.172.30.62) port 443 (#0)
  • Unknown SSL protocol error in connection to cmip3.dkrz.de:-9800
  • Closing connection 0
    curl error details:

cdo sinfo: Open failed on >https://cmip3.dkrz.de/thredds/dodsC/cmip5/output1/CCCma/CanESM2/historical/day/atmos/day/r1i1p1/v20120410/pr/pr_day_CanESM2_historical_r1i1p1_18500101-20051231.nc<
Unknown Error

Any support appreciated!

Best regards, dave r.


Replies (2)

RE: CDO fails for ESGF opendap urls - Added by David Rayner almost 10 years ago

ooops, forgot the details:

$ curl -V
curl 7.35.0 (x86_64-apple-darwin12.5.0) libcurl/7.35.0 OpenSSL/1.0.1f zlib/1.2.8 libidn/1.26
Protocols: dict file ftp ftps gopher http https imap imaps pop3 pop3s rtsp smtp smtps telnet tftp
Features: IDN IPv6 Largefile NTLM NTLM_WB SSL libz TLS-SRP

$ cdo -V
Climate Data Operators version 1.6.4 (http://code.zmaw.de/projects/cdo)
Compiled: by xrayda on mlse3203113.gu.gu.se (x86_64-apple-darwin13.2.0) Jul 2 2014 13:18:19
Compiler: gcc -std=gnu99 -DHAVE_LIBNC_DAP -D_THREAD_SAFE -pthread
version: i686-apple-darwin11-llvm-gcc-4.2 (GCC) 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
Features: PTHREADS NC4 OPeNDAP Z
Libraries:
Filetypes: srv ext ieg grb nc nc2 nc4 nc4c
CDI library version : 1.6.4 of Jul 2 2014 13:18:15
CGRIBEX library version : 1.6.4 of Jun 27 2014 14:00:04
netCDF library version : 4.3.0 of May 9 2014 17:31:34 $
HDF5 library version : 1.8.12
SERVICE library version : 1.3.2 of Jul 2 2014 13:18:11
EXTRA library version : 1.3.2 of Jul 2 2014 13:18:08
IEG library version : 1.3.2 of Jul 2 2014 13:18:10
FILE library version : 1.8.2 of Jul 2 2014 13:18:09

$ ncdump -V
...
netcdf library version 4.3.0 of Jan 29 2014 15:29:11 $

$ uname -a
Darwin mlse3203113.mydomain.example 13.2.0 Darwin Kernel Version 13.2.0: Thu Apr 17 23:03:13 PDT 2014; root:xnu-2422.100.13~1/RELEASE_X86_64 x86_64

RE: CDO fails for ESGF opendap urls - Added by David Rayner almost 10 years ago

AH! looks like I had two versions of netcdf, one in /opt/local and one in /usr/local. Works now with the /opt/local version - do not know why it did not with the other, but not going to spend time investigating...
dave r.

    (1-2/2)