Crawl my data¶
There is a new tool called "crawl_my_data", already loaded when
"module load evaluation_system"
is done.
Per default it is loading the users "projectdata" directory:
/miklip/integration/data4miklip/projectdata/bXXXXXX
https://code.zmaw.de/projects/miklip-d-integration/news#PROJECTDATA
crawl_my_data
would crawl all data you have in
/miklip/integration/data4miklip/projectdata/bXXXXXX
When you have a lot of data in your directory, it could be worth it,
to take just a sub-directory. This gets much faster, when less data.
EXAMPLE: You've put in a new decadal experiment and just want to add
this-
crawl_my_data --path /miklip/integration/data4miklip/projectdata/bXXXXXX/output/MPI-M/MPI-ESM-LR/dec08o2000/
If you have an additional projectdata for official data, like "vady"
just do:
crawl_my_data --path /miklip/integration/data4miklip/projectdata/vady