Using the MiKlip Evaluation System¶
... in the web¶
To log in to the miklip system you may use a browser:
use your DKRZ login! Here you find some frequently asked questions Q_and_A.
... in the shell¶
To log in to the miklip system you may use ssh from any linux/unix system:
ssh -X email@example.com
The -X will allow you to connect to the remote X server (e.g. to display images).
b123456 should be your DKRZ account, if you still don't have one please read: [[miklip:Access to MiKlip Server]].
Start setting up the environment by loading the proper module (You may copy the following line as is into your shell):
module load miklip-ces
This activates the system for your current session. You might notice some other modules have been loaded.
WARNING: The evaluation_system works in bash, to avoid incompabilities choose bash as the default shell: luv.dkrz.de
Developers note: The module just loads other required modules and extends
PATHto point to to evaluation_system/bin and
Overview of implemented Plugins - always shell & web¶
The Plugin Section
including plugin documentation, if available...
Working with Freva¶Freva is the all in one framework with the main features:
Freva Available commands: --plugin : Applies some analysis to the given data. --history : provides access to the configuration history (use --help for more help) --databrowser : Find data in the system --crawl_my_data: Use this command to update your projectdata. --esgf : Browse ESGF data and create wget script This is the main tool for the evaluation system. Usage: freva --COMMAND [OPTIONS] To get help for the individual commands use freva --COMMAND --help
|--plugin||apply some analysis tool||
|--history||browser your history||
|--databrowser||Search CMIP5, MIKLIP or your data with the fast auto-completion browser. If you are in bash, try hitting tab twice whenever you want to input a new attribute or value for the search, you'll see all possible values listed.||
|--crawl_my_data||when you have your own little database, how2put your data into database||
|--esgf||Contact the esgf to query for datasets files and retrieve the wget script used for download them||
All commands have a
--help flag to display the commands help.
|To get the main help||
|To list the tools||
|To get the tool help||
|To see the history||
|To see the history help||
The first news with respect to usability:¶
Using&Devoloping (with the old commands!)
Compute PCA for every single ensemble separately¶
Iterate over all ensemble members of the experiment started in 1960 and compute the PCA of them for the variable tas.
In bash this would be:
for file in $(freva --databrowser project=baseline1 variable=tas time_frequency=mon experiment=*1960); do freva --plugin pca input=$file outputdir=/tmp variable=tas pcafile=pca_$(basename $file) done