Commit 121292c7 authored by Marion Bandet's avatar Marion Bandet

reprocess PAO with new corrected phasese

parent a52e8119
Log Work Marion
****************
**19 OCT 2015:** **19 OCT 2015:**
- IBM data management request (IBMassessment.odf) - IBM data management request (IBMassessment.odf)
- regenerate new calibration_pao_29OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO - regenerate new calibration_pao_29OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO
- regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB - regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB
- transfer files via ssh to WERA srv: - transfer files via ssh to WERA srv:
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera wera@132.215.11.14:~/etc/
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera wera@132.215.11.14:~/etc/ * rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera wera@132.215.11.14:~/etc/
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera wera@132.215.11.14:~/etc/
**20 OCT 2015:** **20 OCT 2015:**
...@@ -14,66 +17,67 @@ ...@@ -14,66 +17,67 @@
reprocess calibrations with new, corrected phases: reprocess calibrations with new, corrected phases:
- log onto wera server - log onto wera server
- cd data1/PAO/
- create a directory 2013244_bkp to run test - create a directory 2013244_bkp to run test
- rsync -aud 2013244/ 2013244_bkp/ - rsync -aud 2013244/ 2013244_bkp/
- cd 2013244 - cd 2013244
- what to do? - what to do?
* cd /home/wera/bin
* cd /home/wera/bin * vi do_postprocess_SORT_newCalib.sh
* vi do_postprocess_SORT_newCalib.sh
=> add lines 89 nd 90 rm .SORT, rm .RFI => add lines 89 nd 90 rm .SORT, rm .RFI
* wera_new_calibration.sh
* wera_new_calibration.sh
=> comment lines 28-32 (mv .SORT to SORT0 and .RFI to .RFI0) => comment lines 28-32 (mv .SORT to SORT0 and .RFI to .RFI0)
- try on 2013244: > bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244 - try on 2013244: > bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244
- to process more than one day at a time, use:> bash -x Process_TimePeriod_wera.sh -s PAO -d 2013245 -f 2013273 - to process more than one day at a time, use:> bash -x Process_TimePeriod_wera.sh -s PAO -d 2013245 -f 2013273
- files transfer (PAO) using shell script in /home/wera/bin: do_filetransferssh.sh - files transfer (PAO) using shell script in /home/wera/bin: do_filetransferssh.sh
**21 OCT 2015:** **21 OCT 2015:**
After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with: - After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with:
do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO
do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO
- work on a shell to find out if we have data in the "raw" directories - work on a shell to find out if we have data in the "raw" directories
./checkDataSize.sh 2012347 2012365 * ./checkDataSize.sh 2012347 2012365
./checkDataSize.sh 2013001 2013365 * ./checkDataSize.sh 2013001 2013365
./checkDataSize.sh 2014001 2014365 * ./checkDataSize.sh 2014001 2014365
all logged in ~/data1/PAO/RAWfileSize.log
all logged in ~/data1/PAO/RAWfileSize.log
**27 OCT 2015:** **27 OCT 2015:**
- write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m) - write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m)
- run same script on wera server for PAB (same dates) - run same script on wera server for PAB (same dates)
- modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100. - modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100.
/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth * /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth
- reprocesser CODAR PAP1 pour 10 mai 2013 with: - reprocesser CODAR PAP1 pour 10 mai 2013 with:
* cd hfr-data-processing/postprocessing/codar/
* cd hfr-data-processing/postprocessing/codar/ * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10
**28 OCT 2015:** **28 OCT 2015:**
1- reprocesser CODAR PAP1 pour 11 mai 2013 1- reprocess CODAR PAP1 for May 11, 2013
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11
- ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11
- modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100. - modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100.
/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth * /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth
- reprocesser CODAR STF2 pour 10 mai 2013 - reprocesser CODAR STF2 pour 10 mai 2013
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10 * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11 * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11
2- reprocesser WERA PAB pour september 2013 avec nouvelles phases 2- reprocesser WERA PAB pour september 2013 avec nouvelles phases
=> no data at this time => no data at this time
3- WERA PAO: convert lst files to .mat for new calibrations using radiallst2uv.m
- use RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m to generate new .mat data and use PlotRadialVeloCompa_Sept2013_HFR_ADCP_WERA_v2.m to generate new plots.
**29 OCT 2015:**
- work on figures of WERA PAO generated with new phases.
- realise there is a problem with new calibration output files: they are the same as with the old calibrations...
- investigate on wera server if possible mistake in shell scripts
- transfer with ssh of old calibrations results
- work on MEOPAR HQP section for NCE renewal application
...@@ -43,3 +43,11 @@ Below are the field experiments used to conduct comparisons between HFR and buoy ...@@ -43,3 +43,11 @@ Below are the field experiments used to conduct comparisons between HFR and buoy
20130830 20130830
20140506 20140506
Log Work Marion
----------------
.. toctree::
:maxdepth: 2
dailylog.rst
...@@ -6,7 +6,7 @@ ...@@ -6,7 +6,7 @@
<head> <head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>&lt;no title&gt; &mdash; documentation_HFR_analysis 0.0.1 documentation</title> <title>Log Work Marion &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" /> <link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" /> <link rel="stylesheet" href="_static/pygments.css" type="text/css" />
...@@ -23,7 +23,8 @@ ...@@ -23,7 +23,8 @@
<script type="text/javascript" src="_static/jquery.js"></script> <script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script> <script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script> <script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" /> <link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="prev" title="Experiment on May 06, 2014" href="20140506.html" />
</head> </head>
<body> <body>
<div class="related"> <div class="related">
...@@ -32,6 +33,9 @@ ...@@ -32,6 +33,9 @@
<li class="right" style="margin-right: 10px"> <li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
accesskey="I">index</a></li> accesskey="I">index</a></li>
<li class="right" >
<a href="20140506.html" title="Experiment on May 06, 2014"
accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li> <li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul> </ul>
</div> </div>
...@@ -41,7 +45,9 @@ ...@@ -41,7 +45,9 @@
<div class="bodywrapper"> <div class="bodywrapper">
<div class="body"> <div class="body">
<p><strong>19 OCT 2015:</strong></p> <div class="section" id="log-work-marion">
<h1>Log Work Marion<a class="headerlink" href="#log-work-marion" title="Permalink to this headline"></a></h1>
<p><strong>19 OCT 2015:</strong></p>
<ul> <ul>
<li><p class="first">IBM data management request (IBMassessment.odf)</p> <li><p class="first">IBM data management request (IBMassessment.odf)</p>
</li> </li>
...@@ -49,13 +55,14 @@ ...@@ -49,13 +55,14 @@
</li> </li>
<li><p class="first">regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB</p> <li><p class="first">regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB</p>
</li> </li>
<li><p class="first">transfer files via ssh to WERA srv:</p> <li><dl class="first docutils">
<blockquote> <dt>transfer files via ssh to WERA srv:</dt>
<div><ul class="simple"> <dd><ul class="first last simple">
<li>rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>:~/etc/</li> <li>rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>:~/etc/</li>
<li>rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>:~/etc/</li> <li>rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>:~/etc/</li>
</ul> </ul>
</div></blockquote> </dd>
</dl>
</li> </li>
</ul> </ul>
<p><strong>20 OCT 2015:</strong></p> <p><strong>20 OCT 2015:</strong></p>
...@@ -63,21 +70,24 @@ ...@@ -63,21 +70,24 @@
<ul> <ul>
<li><p class="first">log onto wera server</p> <li><p class="first">log onto wera server</p>
</li> </li>
<li><p class="first">cd data1/PAO/</p>
</li>
<li><p class="first">create a directory 2013244_bkp to run test</p> <li><p class="first">create a directory 2013244_bkp to run test</p>
</li> </li>
<li><p class="first">rsync -aud 2013244/ 2013244_bkp/</p> <li><p class="first">rsync -aud 2013244/ 2013244_bkp/</p>
</li> </li>
<li><p class="first">cd 2013244</p> <li><p class="first">cd 2013244</p>
</li> </li>
<li><p class="first">what to do?</p> <li><dl class="first docutils">
<blockquote> <dt>what to do?</dt>
<div><ul> <dd><ul class="first last">
<li><p class="first">cd /home/wera/bin</p> <li><p class="first">cd /home/wera/bin</p>
</li> </li>
<li><p class="first">vi do_postprocess_SORT_newCalib.sh</p> <li><dl class="first docutils">
<blockquote> <dt>vi do_postprocess_SORT_newCalib.sh</dt>
<div><p>=&gt; add lines 89 nd 90 rm .SORT, rm .RFI</p> <dd><p class="first last">=&gt; add lines 89 nd 90 rm .SORT, rm .RFI</p>
</div></blockquote> </dd>
</dl>
</li> </li>
<li><dl class="first docutils"> <li><dl class="first docutils">
<dt>wera_new_calibration.sh</dt> <dt>wera_new_calibration.sh</dt>
...@@ -86,7 +96,8 @@ ...@@ -86,7 +96,8 @@
</dl> </dl>
</li> </li>
</ul> </ul>
</div></blockquote> </dd>
</dl>
</li> </li>
<li><p class="first">try on 2013244: &gt; bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244</p> <li><p class="first">try on 2013244: &gt; bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244</p>
</li> </li>
...@@ -96,52 +107,86 @@ ...@@ -96,52 +107,86 @@
</li> </li>
</ul> </ul>
<p><strong>21 OCT 2015:</strong></p> <p><strong>21 OCT 2015:</strong></p>
<p>After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with:</p> <ul>
<p>do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO</p> <li><dl class="first docutils">
<ul class="simple"> <dt>After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with:</dt>
<li>work on a shell to find out if we have data in the &#8220;raw&#8221; directories</li> <dd><p class="first last">do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO</p>
</dd>
</dl>
</li>
<li><dl class="first docutils">
<dt>work on a shell to find out if we have data in the &#8220;raw&#8221; directories</dt>
<dd><ul class="first last simple">
<li>./checkDataSize.sh 2012347 2012365</li>
<li>./checkDataSize.sh 2013001 2013365</li>
<li>./checkDataSize.sh 2014001 2014365</li>
</ul>
</dd>
</dl>
</li>
</ul> </ul>
<blockquote> <blockquote>
<div>./checkDataSize.sh 2012347 2012365 <div>all logged in ~/data1/PAO/RAWfileSize.log</div></blockquote>
./checkDataSize.sh 2013001 2013365
./checkDataSize.sh 2014001 2014365</div></blockquote>
<p>all logged in ~/data1/PAO/RAWfileSize.log</p>
<p><strong>27 OCT 2015:</strong></p> <p><strong>27 OCT 2015:</strong></p>
<ul class="simple"> <ul>
<li>write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m)</li> <li><p class="first">write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m)</p>
<li>run same script on wera server for PAB (same dates)</li> </li>
<li>modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100.</li> <li><p class="first">run same script on wera server for PAB (same dates)</p>
</li>
<li><dl class="first docutils">
<dt>modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100.</dt>
<dd><ul class="first last simple">
<li>/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth</li>
</ul> </ul>
<p>/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth </dd>
- reprocesser CODAR PAP1 pour 10 mai 2013 with:</p> </dl>
<blockquote> </li>
<div><ul class="simple"> <li><dl class="first docutils">
<dt>reprocesser CODAR PAP1 pour 10 mai 2013 with:</dt>
<dd><ul class="first last simple">
<li>cd hfr-data-processing/postprocessing/codar/</li> <li>cd hfr-data-processing/postprocessing/codar/</li>
<li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10</li> <li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10</li>
</ul> </ul>
</div></blockquote> </dd>
<p><strong>28 OCT 2015:</strong></p> </dl>
<p>1- reprocesser CODAR PAP1 pour 11 mai 2013</p> </li>
<blockquote>
<div><ul class="simple">
<li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11</li>
</ul> </ul>
</div></blockquote> <p><strong>28 OCT 2015:</strong></p>
<ul class="simple"> <p>1- reprocess CODAR PAP1 for May 11, 2013</p>
<li>modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100.</li> <ul>
<li><p class="first">./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11</p>
</li>
<li><dl class="first docutils">
<dt>modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100.</dt>
<dd><ul class="first last simple">
<li>/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth</li>
</ul> </ul>
<p>/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth </dd>
- reprocesser CODAR STF2 pour 10 mai 2013</p> </dl>
<blockquote> </li>
<div><ul class="simple"> <li><dl class="first docutils">
<dt>reprocesser CODAR STF2 pour 10 mai 2013</dt>
<dd><ul class="first last simple">
<li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10</li> <li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10</li>
<li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11</li> <li>./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11</li>
</ul> </ul>
</div></blockquote> </dd>
</dl>
</li>
</ul>
<dl class="docutils"> <dl class="docutils">
<dt>2- reprocesser WERA PAB pour september 2013 avec nouvelles phases</dt> <dt>2- reprocesser WERA PAB pour september 2013 avec nouvelles phases</dt>
<dd>=&gt; no data at this time</dd> <dd>=&gt; no data at this time</dd>
</dl> </dl>
<p>3- WERA PAO: convert lst files to .mat for new calibrations using radiallst2uv.m
- use RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m to generate new .mat data and use PlotRadialVeloCompa_Sept2013_HFR_ADCP_WERA_v2.m to generate new plots.</p>
<p><strong>29 OCT 2015:</strong>
- work on figures of WERA PAO generated with new phases.
- realise there is a problem with new calibration output files: they are the same as with the old calibrations...
- investigate on wera server if possible mistake in shell scripts
- transfer with ssh of old calibrations results
- work on MEOPAR HQP section for NCE renewal application</p>
</div>
</div> </div>
...@@ -149,6 +194,9 @@ ...@@ -149,6 +194,9 @@
</div> </div>
<div class="sphinxsidebar"> <div class="sphinxsidebar">
<div class="sphinxsidebarwrapper"> <div class="sphinxsidebarwrapper">
<h4>Previous topic</h4>
<p class="topless"><a href="20140506.html"
title="previous chapter">Experiment on May 06, 2014</a></p>
<h3>This Page</h3> <h3>This Page</h3>
<ul class="this-page-menu"> <ul class="this-page-menu">
<li><a href="_sources/dailylog.txt" <li><a href="_sources/dailylog.txt"
...@@ -177,6 +225,9 @@ ...@@ -177,6 +225,9 @@
<li class="right" style="margin-right: 10px"> <li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
>index</a></li> >index</a></li>
<li class="right" >
<a href="20140506.html" title="Experiment on May 06, 2014"
>previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li> <li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul> </ul>
</div> </div>
......
...@@ -113,6 +113,14 @@ ...@@ -113,6 +113,14 @@
</ul> </ul>
</div> </div>
</div> </div>
<div class="section" id="log-work-marion">
<h2>Log Work Marion<a class="headerlink" href="#log-work-marion" title="Permalink to this headline"></a></h2>
<div class="toctree-wrapper compound">
<ul>
<li class="toctree-l1"><a class="reference internal" href="dailylog.html">Log Work Marion</a></li>
</ul>
</div>
</div>
</div> </div>
...@@ -126,6 +134,7 @@ ...@@ -126,6 +134,7 @@
<li><a class="reference internal" href="#">Welcome to the documentation of High Frequency Radars (CODAR and WERA)</a><ul> <li><a class="reference internal" href="#">Welcome to the documentation of High Frequency Radars (CODAR and WERA)</a><ul>
<li><a class="reference internal" href="#postprocessing">Postprocessing</a></li> <li><a class="reference internal" href="#postprocessing">Postprocessing</a></li>
<li><a class="reference internal" href="#experiments">Experiments</a></li> <li><a class="reference internal" href="#experiments">Experiments</a></li>
<li><a class="reference internal" href="#log-work-marion">Log Work Marion</a></li>
</ul> </ul>
</li> </li>
</ul> </ul>
......
This diff is collapsed.
Log Work Marion
****************
**19 OCT 2015:** **19 OCT 2015:**
- IBM data management request (IBMassessment.odf) - IBM data management request (IBMassessment.odf)
- regenerate new calibration_pao_29OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO - regenerate new calibration_pao_29OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO
- regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB - regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB
- transfer files via ssh to WERA srv: - transfer files via ssh to WERA srv:
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera wera@132.215.11.14:~/etc/
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera wera@132.215.11.14:~/etc/ * rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera wera@132.215.11.14:~/etc/
* rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera wera@132.215.11.14:~/etc/
**20 OCT 2015:** **20 OCT 2015:**
...@@ -14,66 +17,67 @@ ...@@ -14,66 +17,67 @@
reprocess calibrations with new, corrected phases: reprocess calibrations with new, corrected phases:
- log onto wera server - log onto wera server
- cd data1/PAO/
- create a directory 2013244_bkp to run test - create a directory 2013244_bkp to run test
- rsync -aud 2013244/ 2013244_bkp/ - rsync -aud 2013244/ 2013244_bkp/
- cd 2013244 - cd 2013244
- what to do? - what to do?
* cd /home/wera/bin
* cd /home/wera/bin * vi do_postprocess_SORT_newCalib.sh
* vi do_postprocess_SORT_newCalib.sh
=> add lines 89 nd 90 rm .SORT, rm .RFI => add lines 89 nd 90 rm .SORT, rm .RFI
* wera_new_calibration.sh
* wera_new_calibration.sh
=> comment lines 28-32 (mv .SORT to SORT0 and .RFI to .RFI0) => comment lines 28-32 (mv .SORT to SORT0 and .RFI to .RFI0)
- try on 2013244: > bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244 - try on 2013244: > bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244
- to process more than one day at a time, use:> bash -x Process_TimePeriod_wera.sh -s PAO -d 2013245 -f 2013273 - to process more than one day at a time, use:> bash -x Process_TimePeriod_wera.sh -s PAO -d 2013245 -f 2013273
- files transfer (PAO) using shell script in /home/wera/bin: do_filetransferssh.sh - files transfer (PAO) using shell script in /home/wera/bin: do_filetransferssh.sh
**21 OCT 2015:** **21 OCT 2015:**
After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with: - After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with:
do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO
do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO
- work on a shell to find out if we have data in the "raw" directories - work on a shell to find out if we have data in the "raw" directories
./checkDataSize.sh 2012347 2012365 * ./checkDataSize.sh 2012347 2012365
./checkDataSize.sh 2013001 2013365 * ./checkDataSize.sh 2013001 2013365
./checkDataSize.sh 2014001 2014365 * ./checkDataSize.sh 2014001 2014365
all logged in ~/data1/PAO/RAWfileSize.log
all logged in ~/data1/PAO/RAWfileSize.log
**27 OCT 2015:** **27 OCT 2015:**
- write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m) - write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m)
- run same script on wera server for PAB (same dates) - run same script on wera server for PAB (same dates)
- modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100. - modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100.
/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth * /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth
- reprocesser CODAR PAP1 pour 10 mai 2013 with: - reprocesser CODAR PAP1 pour 10 mai 2013 with:
* cd hfr-data-processing/postprocessing/codar/
* cd hfr-data-processing/postprocessing/codar/ * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10
**28 OCT 2015:** **28 OCT 2015:**
1- reprocesser CODAR PAP1 pour 11 mai 2013 1- reprocess CODAR PAP1 for May 11, 2013
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11
- ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11
- modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100. - modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100.
/Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth * /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth
- reprocesser CODAR STF2 pour 10 mai 2013 - reprocesser CODAR STF2 pour 10 mai 2013
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10 * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10
* ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11 * ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11
2- reprocesser WERA PAB pour september 2013 avec nouvelles phases 2- reprocesser WERA PAB pour september 2013 avec nouvelles phases
=> no data at this time => no data at this time
3- WERA PAO: convert lst files to .mat for new calibrations using radiallst2uv.m
- use RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m to generate new .mat data and use PlotRadialVeloCompa_Sept2013_HFR_ADCP_WERA_v2.m to generate new plots.
**29 OCT 2015:**
- work on figures of WERA PAO generated with new phases.
- realise there is a problem with new calibration output files: they are the same as with the old calibrations...
- investigate on wera server if possible mistake in shell scripts
- transfer with ssh of old calibrations results
- work on MEOPAR HQP section for NCE renewal application
...@@ -43,3 +43,11 @@ Below are the field experiments used to conduct comparisons between HFR and buoy ...@@ -43,3 +43,11 @@ Below are the field experiments used to conduct comparisons between HFR and buoy
20130830 20130830
20140506 20140506
Log Work Marion
----------------
.. toctree::
:maxdepth: 2
dailylog.rst
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment