Project

General

Profile

CDO configuration with Cygwin and ncdf file size limit on windows

Added by Anonymous about 13 years ago

Dear all,

Currently I am trying to use the 'splityear' operator to cut a large (3.5gb) ncdf file in pieces. I installed the win32 version on my Windows Vista Intel Core Duo T8100 2.10 GHZ, 4,00gb ram. The win32.zip version works fine up to 2.1 gb or so (so it only splits about 2/3 of the file). The error message reads: assertion failed: offset>= 0, file posixio.c line 414. The application has requested the Runtime to terminate it in an unusual way. As I thought it might be due to the stripped down version of CDO for Windows and some limit on file size, I also tried to install CDO using Cygwin with the libs4cdo library. The configuration however, keeps suppressing the netcdf library. I use the following command to configure CDO:

$ ./configure --with-ncdf-=PREFIX/libs4cdo-0.0.7/ --with-hdf5=PREFIX/libs4cdo-0.0.7/

I also tried including the szlib and zlib libraries (ie. --with-zlib=PREFIX/libs4cdo-0.0.7 and --with-szlib=PREFIX/libs4cdo-0.0.7) and a bunch of other libs.

The configuration works and is finished by Cygwin, but suppresses the netcdf library. With the command line including only netcdf and hdf5, i get the following message:

checking zlib.h usability... yes
checking zlib.h presence... yes
checking for zlib.h... yes
checking for library containing deflate... --lz
checking for szlib library... suppressed
checking hdf5.h usability... yes
checking hdf5.h presence... yes
checking for hdf5.h... yes
checking for library containing H5Fopen... --lhdf5
checking for library containing H5DSis_scale... no
configure: Cannot link to hdf5 high level interface! It is required for netCDF4.
HDF5 must be bui
lt with zlib; the location of zlib must be specified for HDF5 with the
--with-zlib option. If HD
F5 was also built with szlib, then the location of szlib must also be
specified with the --with-
szlib option..
checking for NETCDF library... suppressed

Including netcdf, hdf5 and zlib gives the same message.

Including netcdf, hdf5 (with and without zlib), and szlib gives: 'configure: error: Could not link to szlib'

Am I missing some package or library? Or am I doing something wrong with the configuration? And will installing CDO using Cygwin actually solve the problem of the 2.1gb limit?

Thanks a lot for your help!

Laurens


Replies (7)

RE: CDO configuration with Cygwin and ncdf file size limit on windows - Added by Ralf Mueller about 13 years ago

It would be helpfull to have the config.log from cdo's configure run. Did you use the gcc4 package of cygwin?
Using Cygwin there should be no 2GB limit.

regards
ralf

RE: CDO configuration with Cygwin and ncdf file size limit on windows - Added by Anonymous about 13 years ago

First of all, thanks for the quick reply! attached the logs of (1) configuration with netcdf, hdf5 and zlib, and (2) with netcdf, hdf5, zlib, and szlib. I have the gcc4 package installed.

Thanks a lot for your help!

Laurens

config.log (10.7 KB) config.log config_withoutszlib.log
config.log (10.7 KB) config.log config_withszlib.log

RE: CDO configuration with Cygwin and ncdf file size limit on windows - Added by Anonymous about 13 years ago

Seems like i uploaded the same file twice (with szlib), so now the config.log without szlib.

config.log (53.8 KB) config.log config_withoutszlib.log

RE: CDO configuration with Cygwin and ncdf file size limit on windows - Added by Anonymous about 13 years ago

No.. In the end I asked for the data in parts, after which I cut it up using CDO. But thanks for the help in any case, it really is a useful tool!

RE: CDO configuration with Cygwin and ncdf file size limit on windows - Added by Ralf Mueller about 13 years ago

That's weird, because I did not get such errors with cygwin (see #995).

    (1-7/7)