Project

General

Profile

Forums » Support »

cdo infon (Warning): Found XXXXX of YYYYY missing values!

Added by Olivier Titaud 3 months ago

Dear all,

I face a problem with a netCDF file. When I run the infon operator I get the following message for a variable:

cdo    infon (Warning): Found 3141142 of 3141117 missing values!

When I check the file (e.g. with python) I find 3141117 points equal to fillValue (in that case 9.96921e+36). So what are the (3141142 - 3141117) = 25 found extra missing values points ???

Can you help me to interpret this message correctly ?

Thanks

Ol.


Replies (4)

RE: cdo infon (Warning): Found XXXXX of YYYYY missing values! - Added by Uwe Schulzweida 3 months ago

Dear Olivier,

When reading the field, it had 3141117 missing value and infon found 3141142. Between reading and infon the number of missing values seems to have increased without it being registered. This can have various causes and may also be an error.
Can you give us access to this file and send us the CDO command line to analyze this?

Thanks,
Uwe

RE: cdo infon (Warning): Found XXXXX of YYYYY missing values! - Added by Olivier Titaud 3 months ago

Dear Uwe,

Thank you for your quick answer ! You will find the file attached. I croped the domain in order to make the file lighter. The number of missing values is now 35013 of 34988, that is 25 extra values still. Maybe I didn't really understand the definition of "missing values". After further investigation, I realized that these values are nan (when reading it with python). Is that the definition of missing values ? To be different from FillValue ?

Best regards

Olivier

temperature_20240718.crop.nc (1.07 MB) temperature_20240718.crop.nc

RE: cdo infon (Warning): Found XXXXX of YYYYY missing values! - Added by Uwe Schulzweida 3 months ago

Dear Olivier,

There are 25 NaN values in the 2nd layer. You can set these value to missing with setctomiss,nan:

cdo infon -setctomiss,nan temperature_20240718.crop.nc 
cdo(1) setctomiss: Process started
    -1 :       Date     Time   Level Gridsize    Miss :     Minimum        Mean     Maximum : Parameter name
     1 : 2024-07-17 00:00:00       1    87001   27273 :     0.78754      11.274      21.774 : T             
     2 : 2024-07-17 00:00:00       2    87001   35013 :      1.2857      10.368      20.956 : T             
     3 : 2024-07-17 00:00:00       3    87001   41110 :      1.5020      7.1247      17.287 : T
Best regards,
Uwe

    (1-4/4)