Commit 9ce85642deabb32205a993b5f5a98dc9e25941c6

Authored by Marion Bandet
1 parent f45a2133
Exists in master

update calibration outputs PAO and PAB

build/doctrees/calibration.doctree
No preview for this file type
build/doctrees/environment.pickle
No preview for this file type
build/doctrees/index.doctree
No preview for this file type
build/html/_sources/calibration.txt
... ... @@ -79,8 +79,8 @@ Go to the **"Submesoscale"** `wiki`_ and click on "useful links" under **Outils*
79 79  
80 80  
81 81  
82   -Steps to generate new calibration file
83   -*****************************************
  82 +1. Steps to generate new calibration phases
  83 +*********************************************
84 84  
85 85 #. loggin to the wera server wera@132.215.11.14
86 86 #. cd etc/
... ... @@ -109,14 +109,15 @@ The tracks can be found in :
109 109 - /hfr-data-processing/calibrations/PAB/FlamentPAB_Track_30-OCT-14 182008.gpx
110 110  
111 111 We use the routine **GPS_gpx2mat.m** to convert .gpx files into .mat files.
  112 +
112 113 We use the routine **WERA_AntennaCoord_txt2mat.m** to transform the .txt files with antennas'coordinates to .mat files.
  114 +
113 115 We use the routine **WERAphase_txt2mat.m** to convert the .txt files containing phases into .mat files.
114 116  
115 117 The routine **WERAcalibration.m** is available at this `page`_.
116 118  
117 119 .. _page: WERAcalibration.html
118 120  
119   -
120 121 All the Matlab routines used for the data processing are located in **~/hfr-data-processing/calibrations/**.
121 122  
122 123  
... ... @@ -125,7 +126,7 @@ Outputs of **WERAcalibration.m** for PAO site are available here: `calibrationPA
125 126 .. _calibrationPAO: calibPAO.html
126 127  
127 128 +---------------------------------------------+
128   -| PAO - Helzel |
  129 +| PAO - Helzel- Phases in degrees |
129 130 +-------------+-----------------+-------------+
130 131 | Antenna nb | original phase | new phase |
131 132 +=============+=================+=============+
... ... @@ -154,14 +155,16 @@ Outputs of **WERAcalibration.m** for PAO site are available here: `calibrationPA
154 155 | 12 | -9.7778 | 153.9098 |
155 156 +-------------+-----------------+-------------+
156 157  
  158 +The new phase values were saved under **calibration_pao_29OCT2014.wera**.
157 159  
  160 +
158 161 Outputs of WERAcalibration.m for PAB site are available here: `calibrationPAB`_
159 162  
160 163 .. _calibrationPAB: calibPAB.html
161 164  
162 165  
163 166 +---------------------------------------------+
164   -| PAB - Helzel |
  167 +| PAB - Helzel - Phases in degrees |
165 168 +-------------+-----------------+-------------+
166 169 | Antenna nb | original phase | new phase |
167 170 +=============+=================+=============+
... ... @@ -190,40 +193,51 @@ Outputs of WERAcalibration.m for PAB site are available here: `calibrationPAB`_
190 193 | 12 | -2.7529 | 7.4966 |
191 194 +-------------+-----------------+-------------+
192 195  
  196 +The new phase values were saved under **calibration_pab_30OCT2014.wera**.
193 197  
194 198  
195 199  
196 200  
197   -Re-processing of radial currents with new phases
  201 +2. Re-processing of radial currents with new phases
198 202 ***************************************************
199 203  
200   -For the all month of September 2013, we are going to generate new files using the new calibration phases.
  204 +For the all month of September 2013, we are going to generate new radial currents using the new calibration phases.
201 205  
202   -Post-processing of WERA radial currents is documented `here`_.
  206 +Common steps for the post-processing of WERA radial currents is documented `here`_.
203 207  
204 208 .. _here: WERAprocessing.html
205 209  
206   -For example, let us see what we have to do to generate radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):
207 210  
208   -Data in the ~/data1/PAO/2013244/raw/ folder are converted in .SORT and .RFI in the ~/data1/PAO/2013244/results/ folder using the **do_process_SORT_pol** shell script. These files are generated using the "original" calibration phases.
  211 +For example, let us see what we have to do to generate new radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):
  212 +
  213 + - loggin to the wera server
  214 +
  215 + - go to the folder containing the data:
  216 +
  217 + . cd ~/data1/PAO/2013244/
  218 + . the raw currents are located in **2013244/raw/**
  219 + . the analysis takes the raw currents, apply the calibration phases and save the resulting radial currents in **/2013244/results/** under .SORT and .RFI files using the **do_process_SORT_pol** shell script. This is done using the original calibration phases.
  220 + . the new radial currents using the updated calibration phases will be saved under **/2013244/results/new**.
209 221  
210 222  
211 223  
212   -First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script **changeName.sh** located in /hfr-data-processing/postprocessing/wera/.
  224 + - First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script **changeName.sh** located in **/hfr-data-processing/postprocessing/wera/**.
213 225  
214   -.SORT====> .SORT0 (generated with original calibration)
215   -.RFI ====> .RFI0
  226 + - then we need to create a symbolic link to specify with files to use in terms of calibration phases. This file is different for each site.
216 227  
  228 + For the example taken here (site = PAO): calibration.wera.apply ---> calibration_pao_29OCT2014.wera and calibration.wera.remove -----> calibration_pao.wera
217 229  
218 230  
  231 + - then we need to run **MODIFY_WERA_SORT** to generate new .SORT and .RFI files using the new calibration phases.
219 232  
220   -as well as 2 symbolic links to point towards which file is the calibration to remove (with link calibration.wera.remove) and which file is the calibration to use (with link calibration.wera.apply).
  233 +All these steps are done in a shell script **do_postprocess_SORT_newCalib.sh** that calls **wera_new_calibration.sh**.
  234 +
221 235  
  236 +Large data files transfer has been automatized in **do_filetransferssh.sh** that calls **fileTransferSSH.sh**.
  237 +
  238 +All the shell scripts are located on the WERA server under **/home/wera/bin/**.
222 239  
223   -If we look at what the content of the calibration file is:
224   - * cat calibration_pab.wera
225 240  
226   -We want to compare the value of the phase given in the 3rd column with the one that we compute.
227 241  
228 242  
229 243  
... ...
build/html/_sources/index.txt
... ... @@ -22,6 +22,7 @@ Documentation about the steps of the analysis
22 22 WERAprocessing
23 23 calibration
24 24 calibPAO
  25 + calibPAB
25 26 Comparison_WERA-ADCP_Sept2013
26 27 CurrentsCombination
27 28  
... ...
build/html/calibration.html
... ... @@ -113,8 +113,8 @@
113 113 <p class="topic-title first">Objectives</p>
114 114 <p>We need to &#8220;remove wrong calibration data and apply new ones&#8221;, so we need to use Modify_WERA_SORT.</p>
115 115 </div>
116   -<div class="section" id="steps-to-generate-new-calibration-file">
117   -<h3>Steps to generate new calibration file<a class="headerlink" href="#steps-to-generate-new-calibration-file" title="Permalink to this headline">¶</a></h3>
  116 +<div class="section" id="steps-to-generate-new-calibration-phases">
  117 +<h3>1. Steps to generate new calibration phases<a class="headerlink" href="#steps-to-generate-new-calibration-phases" title="Permalink to this headline">¶</a></h3>
118 118 <blockquote>
119 119 <div><ol class="arabic simple">
120 120 <li>loggin to the wera server <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a></li>
... ... @@ -154,9 +154,9 @@
154 154 </ul>
155 155 </dd>
156 156 </dl>
157   -<p>We use the routine <strong>GPS_gpx2mat.m</strong> to convert .gpx files into .mat files.
158   -We use the routine <strong>WERA_AntennaCoord_txt2mat.m</strong> to transform the .txt files with antennas&#8217;coordinates to .mat files.
159   -We use the routine <strong>WERAphase_txt2mat.m</strong> to convert the .txt files containing phases into .mat files.</p>
  157 +<p>We use the routine <strong>GPS_gpx2mat.m</strong> to convert .gpx files into .mat files.</p>
  158 +<p>We use the routine <strong>WERA_AntennaCoord_txt2mat.m</strong> to transform the .txt files with antennas&#8217;coordinates to .mat files.</p>
  159 +<p>We use the routine <strong>WERAphase_txt2mat.m</strong> to convert the .txt files containing phases into .mat files.</p>
160 160 <p>The routine <strong>WERAcalibration.m</strong> is available at this <a class="reference external" href="WERAcalibration.html">page</a>.</p>
161 161 <p>All the Matlab routines used for the data processing are located in <strong>~/hfr-data-processing/calibrations/</strong>.</p>
162 162 <p>Outputs of <strong>WERAcalibration.m</strong> for PAO site are available here: <a class="reference external" href="calibPAO.html">calibrationPAO</a></p>
... ... @@ -167,7 +167,7 @@ We use the routine &lt;strong&gt;WERAphase_txt2mat.m&lt;/strong&gt; to convert the .txt file
167 167 <col width="30%" />
168 168 </colgroup>
169 169 <thead valign="bottom">
170   -<tr class="row-odd"><th class="head" colspan="3">PAO - Helzel</th>
  170 +<tr class="row-odd"><th class="head" colspan="3">PAO - Helzel- Phases in degrees</th>
171 171 </tr>
172 172 <tr class="row-even"><th class="head">Antenna nb</th>
173 173 <th class="head">original phase</th>
... ... @@ -225,6 +225,7 @@ We use the routine &lt;strong&gt;WERAphase_txt2mat.m&lt;/strong&gt; to convert the .txt file
225 225 </tr>
226 226 </tbody>
227 227 </table>
  228 +<p>The new phase values were saved under <strong>calibration_pao_29OCT2014.wera</strong>.</p>
228 229 <p>Outputs of WERAcalibration.m for PAB site are available here: <a class="reference external" href="calibPAB.html">calibrationPAB</a></p>
229 230 <table border="1" class="docutils">
230 231 <colgroup>
... ... @@ -233,7 +234,7 @@ We use the routine &lt;strong&gt;WERAphase_txt2mat.m&lt;/strong&gt; to convert the .txt file
233 234 <col width="30%" />
234 235 </colgroup>
235 236 <thead valign="bottom">
236   -<tr class="row-odd"><th class="head" colspan="3">PAB - Helzel</th>
  237 +<tr class="row-odd"><th class="head" colspan="3">PAB - Helzel - Phases in degrees</th>
237 238 </tr>
238 239 <tr class="row-even"><th class="head">Antenna nb</th>
239 240 <th class="head">original phase</th>
... ... @@ -291,25 +292,41 @@ We use the routine &lt;strong&gt;WERAphase_txt2mat.m&lt;/strong&gt; to convert the .txt file
291 292 </tr>
292 293 </tbody>
293 294 </table>
  295 +<p>The new phase values were saved under <strong>calibration_pab_30OCT2014.wera</strong>.</p>
294 296 </div>
295 297 <div class="section" id="re-processing-of-radial-currents-with-new-phases">
296   -<h3>Re-processing of radial currents with new phases<a class="headerlink" href="#re-processing-of-radial-currents-with-new-phases" title="Permalink to this headline">¶</a></h3>
297   -<p>For the all month of September 2013, we are going to generate new files using the new calibration phases.</p>
298   -<p>Post-processing of WERA radial currents is documented <a class="reference external" href="WERAprocessing.html">here</a>.</p>
299   -<p>For example, let us see what we have to do to generate radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):</p>
300   -<p>Data in the ~/data1/PAO/2013244/raw/ folder are converted in .SORT and .RFI in the ~/data1/PAO/2013244/results/ folder using the <strong>do_process_SORT_pol</strong> shell script. These files are generated using the &#8220;original&#8221; calibration phases.</p>
301   -<p>First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script <strong>changeName.sh</strong> located in /hfr-data-processing/postprocessing/wera/.</p>
302   -<p>.SORT====&gt; .SORT0 (generated with original calibration)
303   -.RFI ====&gt; .RFI0</p>
304   -<p>as well as 2 symbolic links to point towards which file is the calibration to remove (with link calibration.wera.remove) and which file is the calibration to use (with link calibration.wera.apply).</p>
305   -<dl class="docutils">
306   -<dt>If we look at what the content of the calibration file is:</dt>
307   -<dd><ul class="first last simple">
308   -<li>cat calibration_pab.wera</li>
  298 +<h3>2. Re-processing of radial currents with new phases<a class="headerlink" href="#re-processing-of-radial-currents-with-new-phases" title="Permalink to this headline">¶</a></h3>
  299 +<p>For the all month of September 2013, we are going to generate new radial currents using the new calibration phases.</p>
  300 +<p>Common steps for the post-processing of WERA radial currents is documented <a class="reference external" href="WERAprocessing.html">here</a>.</p>
  301 +<p>For example, let us see what we have to do to generate new radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):</p>
  302 +<blockquote>
  303 +<div><ul>
  304 +<li><p class="first">loggin to the wera server</p>
  305 +</li>
  306 +<li><p class="first">go to the folder containing the data:</p>
  307 +<blockquote>
  308 +<div><p>. cd ~/data1/PAO/2013244/
  309 +. the raw currents are located in <strong>2013244/raw/</strong>
  310 +. the analysis takes the raw currents, apply the calibration phases and save the resulting radial currents in <strong>/2013244/results/</strong> under .SORT and .RFI files using the <strong>do_process_SORT_pol</strong> shell script. This is done using the original calibration phases.
  311 +. the new radial currents using the updated calibration phases will be saved under <strong>/2013244/results/new</strong>.</p>
  312 +</div></blockquote>
  313 +</li>
309 314 </ul>
310   -</dd>
311   -</dl>
312   -<p>We want to compare the value of the phase given in the 3rd column with the one that we compute.</p>
  315 +<blockquote>
  316 +<div><ul class="simple">
  317 +<li>First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script <strong>changeName.sh</strong> located in <strong>/hfr-data-processing/postprocessing/wera/</strong>.</li>
  318 +<li>then we need to create a symbolic link to specify with files to use in terms of calibration phases. This file is different for each site.</li>
  319 +</ul>
  320 +<blockquote>
  321 +<div>For the example taken here (site = PAO): calibration.wera.apply &#8212;&gt; calibration_pao_29OCT2014.wera and calibration.wera.remove &#8212;&#8211;&gt; calibration_pao.wera</div></blockquote>
  322 +<ul class="simple">
  323 +<li>then we need to run <strong>MODIFY_WERA_SORT</strong> to generate new .SORT and .RFI files using the new calibration phases.</li>
  324 +</ul>
  325 +</div></blockquote>
  326 +</div></blockquote>
  327 +<p>All these steps are done in a shell script <strong>do_postprocess_SORT_newCalib.sh</strong> that calls <strong>wera_new_calibration.sh</strong>.</p>
  328 +<p>Large data files transfer has been automatized in <strong>do_filetransferssh.sh</strong> that calls <strong>fileTransferSSH.sh</strong>.</p>
  329 +<p>All the shell scripts are located on the WERA server under <strong>/home/wera/bin/</strong>.</p>
313 330 </div>
314 331 <div class="section" id="comparison-old-new-wera-calibrations">
315 332 <h3>COMPARISON OLD/NEW WERA CALIBRATIONS<a class="headerlink" href="#comparison-old-new-wera-calibrations" title="Permalink to this headline">¶</a></h3>
... ... @@ -345,8 +362,8 @@ Superimposed are the 48-h averages&lt;/div&gt;
345 362 </ul>
346 363 </li>
347 364 <li><a class="reference internal" href="#wera">WERA</a><ul>
348   -<li><a class="reference internal" href="#steps-to-generate-new-calibration-file">Steps to generate new calibration file</a></li>
349   -<li><a class="reference internal" href="#re-processing-of-radial-currents-with-new-phases">Re-processing of radial currents with new phases</a></li>
  365 +<li><a class="reference internal" href="#steps-to-generate-new-calibration-phases">1. Steps to generate new calibration phases</a></li>
  366 +<li><a class="reference internal" href="#re-processing-of-radial-currents-with-new-phases">2. Re-processing of radial currents with new phases</a></li>
350 367 <li><a class="reference internal" href="#comparison-old-new-wera-calibrations">COMPARISON OLD/NEW WERA CALIBRATIONS</a></li>
351 368 </ul>
352 369 </li>
... ...
build/html/index.html
... ... @@ -64,14 +64,15 @@
64 64 </ul>
65 65 </li>
66 66 <li class="toctree-l2"><a class="reference internal" href="calibration.html#wera">WERA</a><ul>
67   -<li class="toctree-l3"><a class="reference internal" href="calibration.html#steps-to-generate-new-calibration-file">Steps to generate new calibration file</a></li>
68   -<li class="toctree-l3"><a class="reference internal" href="calibration.html#re-processing-of-radial-currents-with-new-phases">Re-processing of radial currents with new phases</a></li>
  67 +<li class="toctree-l3"><a class="reference internal" href="calibration.html#steps-to-generate-new-calibration-phases">1. Steps to generate new calibration phases</a></li>
  68 +<li class="toctree-l3"><a class="reference internal" href="calibration.html#re-processing-of-radial-currents-with-new-phases">2. Re-processing of radial currents with new phases</a></li>
69 69 <li class="toctree-l3"><a class="reference internal" href="calibration.html#comparison-old-new-wera-calibrations">COMPARISON OLD/NEW WERA CALIBRATIONS</a></li>
70 70 </ul>
71 71 </li>
72 72 </ul>
73 73 </li>
74 74 <li class="toctree-l1"><a class="reference internal" href="calibPAO.html">Outputs of WERAcalibration.m for PAO site</a></li>
  75 +<li class="toctree-l1"><a class="reference internal" href="calibPAB.html">Outputs of WERAcalibration.m for PAB site</a></li>
75 76 <li class="toctree-l1"><a class="reference internal" href="Comparison_WERA-ADCP_Sept2013.html">Comparison WERA and ADCP radial velocities September 2013</a></li>
76 77 <li class="toctree-l1"><a class="reference internal" href="Comparison_WERA-ADCP_Sept2013.html#hfr-direction">HFR direction</a></li>
77 78 <li class="toctree-l1"><a class="reference internal" href="CurrentsCombination.html">Current combination and OGSL data feed</a></li>
... ...
build/html/searchindex.js
1   -Search.setIndex({envversion:42,terms:{all:[0,10,3,6],reprocess:6,month:6,correl:0,marion:[],follow:[10,3],disk:10,paperposit:[],row:[],content:[10,6],misread:6,middl:[],demet:[],program:6,matlab:[0,3,6],under:[0,6],time_calib:[],unzip:3,everi:[7,3,6],wera_antennacoord_txt2mat:6,projet:3,print:[],configuration_:[],volum:10,spectratoprocess:10,cyan:0,isdir:[],hour:[7,3],hfrmat:3,modify_wera_sort:6,measpattern:10,datenum:[],dir:[],pleas:6,direct:[],crop:[],past:10,download:[7,3],"_submesoscal":[],click:6,index:0,what:[10,3,6],compar:[0,6],section:1,advanc:10,abl:6,cell:[],hourli:[0,3,6],conduct:[],"new":7,can:[10,6],codar2:10,codar1:10,gener:7,lon_mid:[],here:[0,6],water:8,let:6,modifi:[],legend:[],valu:6,"200px":0,search:[],datevec:[],idealpattern:10,precis:[],hfr_data_process:3,permit:6,chang:[10,6],pierr:[],via:[0,3],theta_pair:[],pap1_css_:10,appli:6,approxim:3,"_ascii":7,"3e8":[],apm:6,marker:[],should:[7,6],"byte":[],select:0,plot:[],from:7,pere:[],two:6,websit:3,music:[10,6],seasonderadialsetup:6,postprocess:[],simpler:7,rad2tot:3,more:1,sort:[7,6],flamentpab_track_30:6,ylabel:[],flag:10,hold:[],sw_dist:[],retriev:10,currentscombin:[],local:10,setup:10,work:[1,3,6],cat:6,whatev:[],lawrenc:8,deg:10,heur:7,want:6,download_codar_rt:3,uncheck:10,surfac:0,calibrationpab:6,end:[],radial_comparison:0,check_up:[],newcalibr:7,radialvelocompa_sept2013_hfr_adcp_wera_adcpcorrected_v2:0,uqar:[1,7,10],verifi:0,csv:3,config:10,str2doubl:[],mat:[0,7,3,10,6],after:[0,10],spot:8,diagram:[10,6],befor:[0,10],wrong:6,meopar:[0,1,7],attent:10,lat:[],data:[],averag:[0,3,6],youwish:[],onto:0,hfr:[],correspond:0,element:[],inform:[],allow:0,cs4:10,first:6,order:[8,6],oper:6,move:[10,3],meter:[],lst:7,sqrt:[],estuari:8,nombr:[],paramet:[0,10],thumb:0,hfr_lsle_20150817t170000z:3,iml:0,late:[],lonlat2km:[],wrt:[],onc:10,lsle:[7,8],main:1,tri:3,them:6,"return":[],thei:[],dai:[10,7,6],initi:[],systm:[],"break":[],now:[],name:0,separ:[],each:[0,7,3,8],found:[7,6],reprocess_ogsl_hfr_treat:3,xlp:[10,6],fig_hdl:[],crontab:3,delta_phase_ob:[],year:7,wavelength:[],extract:0,orient:0,out:[],variabl:[],"3rd":6,open:[10,6],research:[],categori:[],vector:0,calib:[],calib_fil:[],red:0,fig_w:[],bathymetri:0,differ:[],gridwithnan_adcp:0,org:7,fig_h:[],care:10,angl:0,unwant:[],keep:[],filter:[10,6],caption:[],length:[],radialconfigs_stf2_20130206_bapm_music402002_nosmooth:[],confus:[],lambda:[],origin:[10,6],softwar:6,rang:0,do_process_sort_pol:[7,6],currentshfrwithaverageexport:3,number:[],sometim:10,compsnewcalib_radialvelo_adcp_pao_sept2013:0,date:[7,6],done:6,lat_mid:[],miss:10,given:[0,6],script:[0,7,3,6],system:[7,3],spectraseri:10,saint:8,gpx:6,store:[0,10,6],shell:[7,3,6],travail:3,option:[],season:[],calib_hr:[],copi:[10,3,6],specifi:0,part:1,than:[0,7],png:0,hfr_process:3,stf:[10,3],provid:3,remov:[10,6],structur:0,project:[0,1],xlabel:[],were:[8,6],posit:0,minut:[0,3,6],toward:6,submesoscal:6,seri:[],latitud:[],spectra:10,comput:[0,3,6],adcp_pao_version5adcpcorrected_newcalibrations_v2:0,julian:[7,6],ur_adcp_proj:0,ant:[],raw:[7,6],"20d":10,have:[10,7,6],need:[10,6],ismer:1,calib_min:[],min:3,centimet:[],superimpos:[0,6],note:6,also:10,ideal:10,exampl:[0,10,7,6],take:[],which:6,data1:[7,6],data2:7,sure:10,track:6,choos:0,seasond:10,marin:1,ogsl_hfr_treat:3,deploi:8,phase:10,model:1,clear:[],doe:[10,3],azimuth:0,usual:0,radial2uv:10,calib_year:[],gps_gpx2mat:6,distanc:0,find:[0,1,7,6],fichier:0,onli:[0,10],locat:[7,3,6],calibration_pao:6,phasedifference_:[],calibration_pab:6,dispers:1,theme:[],analyz:0,elseif:[],folder:[10,7,6],adcpbin2vspaosept2013:0,analys:[],oct:6,patt_pap1_2014_01_14_1154_nosmooth:10,calib_tim:[],flament:6,variou:8,get:[0,10],yadcp:0,ssh:[7,3],adcp:[],theta:0,index_timecalib:[],ascii2mat:3,organ:1,helzelpao_track_29:6,contain:[0,6],rfi:[7,6],wiki:6,set:[],incid:[],ftp_transfer:7,matlab_analysi:[],see:6,sec:[],result:[0,7,3],close:[],"55min":3,best:[],patt:6,rad2deg:[],ruv2mat:3,forecast:1,figur:0,between:1,version5_pao_ol_nofullc:7,betwen:0,"15e6":[],isol:[],southeast:[],extent:7,subfold:7,bodi:[],last:3,delimit:[],helzel:6,umean_adcp_v:0,umean_adcp_u:0,april:7,calibration_pab_30oct2014:[],caibrat:[],"15min":0,improv:1,whole:0,load:0,point:[],color:[],had:8,period:0,walk:6,header:10,drogu:8,diff:0,zeta:[],boat:6,coupl:1,fortran:6,come:10,loggin:[10,7,6],"48h":0,due:6,been:10,compon:0,much:7,interest:[0,10],txt:[10,6],download_wera_rt:3,delet:10,imag:[],convert:[7,3,6],coordin:[0,6],togeth:3,calib_valu:[],"_calibr":[],look:[0,6],"_pair":[],"while":6,observ:3,loop:[10,6],metric:6,site:[0,7,3,10],archiv:[10,3],calibrationpao:6,zonal:0,ascii:3,rfi0:6,pap:[10,3,6],dataconvers:[],etc:6,media:[0,7],make:[0,10],belong:6,same:0,pab:[0,7,3],meridion:0,northwest:[],meopar_marion:[],num2str:[],pao:[0,7,3],phi:[],http:3,webserv:3,closest:0,patt_pap1_2012_12_15:6,sort0:6,radialconfigs_pap1_20130201_bapm_music402002_20dsmooth:10,php:[],lower:8,appropri:10,kept:3,center:[],well:6,gps_data:[],thi:[0,1,3,8,6],calibration_pao_29oct2014:[],undertaken:6,everyth:10,bandet:[],left:0,delta_phase_th:[],identifi:7,ddist:[],calibr:[],dyndn:7,wee:[],css_:10,theoret:[],desktop:10,instrument:[8,6],add:10,radialconfig:[10,6],els:[],save:[10,6],modul:[],bin:[0,7,6],march:[10,6],fname:[],format:3,phasang:[],grid:[0,3],know:6,radiallst2uv:7,paperunit:[],measur:10,"_rx_coord":[],trash:10,like:[],hfrdata:3,rangeadcp:0,spectraprocess:10,server:[7,3,10,6],collect:6,either:0,output:7,page:[1,6],r500:[],www:3,right:0,old:[],codarprocess:[],"1st":6,back:10,weraphase_txt2mat:6,sampl:8,home:[7,3],rsync:7,total:[0,3],dlmwrite:[],markerfacecolor:[],avoid:[],"2014_10":6,per:7,seagatewireless:[0,7],estim:0,phases_:[],outil:6,refer:6,run:[0,7,3,10,6],accueil:[],radial:[],delta_r:[],modsym:[],step:[],ruv:[10,3],"20132440000_pao":0,stage:3,comparison:[],about:1,nanmean:[],bandma01:[0,7],column:[8,6],codar_wera_ogsl:3,strcmp:[],degre:0,srv:3,mean:0,routin:[3,6],figdir:[],within:0,automat:10,pair:[],weather:[],phasecalibration_:[],your:[],helzelpab_track_30:6,pabcalibr:[],span:[],log:3,transfer:10,lon:[],transform:[10,6],changenam:6,avail:[0,3,6],start:[10,6],r_mid:[],link:6,yyyyjjj:7,line:10,u_mean_adcp:0,info:1,codardata:10,made:[],save_flag:[],smooth:[10,6],displai:3,until:6,paocalibr:[],record:6,below:1,sum:[],crad_pol_lst:7,"export":3,radialconfigs_pap1_20130201_bapm_music402002_nosmooth:[10,6],creat:10,vr_adcp_proj:0,"int":[],ddsit:[],dpng:[],file:[10,7],pap1:[],check:[],fill:10,antenna:[10,6],titl:[],nan:[],weraprocess:[],field:[1,6],other:1,futur:6,papers:[],you:[1,7,10],"2min34sec":[],relat:1,symbol:6,drift:[0,1],meaning:0,dropbox:[],calib_jd:[],xadcp:0,longitud:[],phi_ant:[],nfile:[],algorithm:0,directori:[3,6],htdoc:3,orientationpaosept2013:0,buoi:[1,8],depth:8,matfil:3,time:0},objtypes:{},objnames:{},filenames:["Comparison_WERA-ADCP_Sept2013","index","20130826","CurrentsCombination","20130830","20130515","calibration","WERAprocessing","20140506","calibPAB","CODARprocessing","calibPAO"],titles:["Comparison WERA and ADCP radial velocities September 2013","Welcome to the documentation of High Frequency Radars (CODAR and WERA)","Experiment on August 26, 2013","Current combination and OGSL data feed","Experiment on August 20, 2013","Experiment on May 15, 2013","Calibrations","WERA radial currents processing","Experiment on May 06, 2014","Outputs of WERAcalibration.m for PAB site","CODAR radial currents processing","Outputs of WERAcalibration.m for PAO site"],objects:{},titleterms:{feed:3,calibr:6,old:6,point:6,process:[10,7,6],direct:0,indic:[],high:1,radar:1,result:[],file:6,tabl:[],pap1:[],check:[],from:6,welcom:1,pere:6,pab:9,current:[7,3,10,6],quasi:[],postprocess:1,conduct:[],weracalibr:[11,9],"new":6,lsle:[],document:1,codar:[1,10,6],pao:11,analysi:[],saint:6,august:[2,4],utc:6,gener:6,object:6,ogsl:3,step:6,stf2:[],adcp:0,output:[11,9],phase:6,post:[],now:6,data:3,radialconfigs_stf2_20121220_bapm_music402002_nosmooth:[],comparison:[0,6],experi:[1,2,5,8,4],radialconfigs_pap1_20121213_wapm_music402002_5dsmooth:[],frequenc:1,veloc:0,hfr:0,list:[],documentation_hfr_analysi:[],wera:[0,1,7,6],combin:3,mai:[5,8],radial:[0,10,7,6],site:[11,9],flavi:6,realtim:[],septemb:0}})
2 1 \ No newline at end of file
  2 +Search.setIndex({envversion:42,terms:{all:[0,10,3,6],reprocess:6,month:6,correl:0,marion:[],follow:[10,3],disk:10,paperposit:[],row:[],content:[10,6],misread:6,middl:[],demet:[],program:6,matlab:[0,3,6],under:[0,6],phases_:[],time_calib:[],unzip:3,everi:[7,3,6],wera_antennacoord_txt2mat:6,projet:3,print:[],configuration_:[],volum:10,spectratoprocess:10,cyan:0,tri:3,hour:[7,3],hfrmat:3,modify_wera_sort:6,measpattern:10,datenum:[],"2min34sec":[],dir:[],pleas:6,direct:[],crop:[],past:10,download:[7,3],"_submesoscal":[],click:6,index:0,what:[10,3,6],compar:[0,6],section:1,advanc:10,abl:6,cell:[],hourli:[0,3,6],conduct:[],"new":7,can:[10,6],codar2:10,codar1:10,gener:7,lon_mid:[],here:[0,6],water:8,let:6,modifi:[],legend:[],valu:6,"200px":0,search:[],datevec:[],idealpattern:10,precis:[],hfr_data_process:3,permit:6,chang:[10,6],pierr:[],via:[0,3],theta_pair:[],pap1_css_:10,appli:6,approxim:3,"_ascii":7,"3e8":[],apm:6,marker:[],dispers:1,fig_h:[],select:0,plot:[],from:7,pere:[],two:6,websit:3,music:[10,6],seasonderadialsetup:6,postprocess:[],taken:6,stage:3,rad2tot:3,more:1,sort:[7,6],flamentpab_track_30:6,ylabel:[],flag:10,hold:[],sw_dist:[],retriev:10,currentscombin:[],analys:[],setup:10,work:[1,3,6],cat:6,whatev:[],deg:10,heur:7,ruv2mat:3,want:6,download_codar_rt:3,uncheck:10,surfac:0,zonal:0,end:[],radial_comparison:0,check_up:[],newcalibr:7,radialvelocompa_sept2013_hfr_adcp_wera_adcpcorrected_v2:0,uqar:[1,7,10],verifi:0,csv:3,config:10,updat:6,str2doubl:[],mat:[0,7,3,10,6],after:[0,10],spot:8,diagram:[10,6],befor:[0,10],wrong:6,meopar:[0,1,7],attent:10,date:[7,6],data:[],averag:[0,3,6],youwish:[],confus:[],spectra:10,correspond:0,element:[],inform:[],allow:0,cs4:10,lambda:[],order:[8,6],oper:6,move:[10,3],meter:[],lst:7,same:0,estuari:8,nombr:[],paramet:[0,10],thumb:0,hfr_lsle_20150817t170000z:3,iml:0,late:[],lonlat2km:[],wrt:[],onc:10,total:[0,3],lsle:[7,8],main:1,isdir:[],them:6,"return":[],thei:[],dai:[10,7,6],initi:[],systm:[],"break":[],now:[],term:6,name:0,separ:[],each:[0,7,3,8,6],found:[7,6],reprocess_ogsl_hfr_treat:3,xlp:[10,6],fig_hdl:[],crontab:3,year:7,wavelength:[],extract:0,orient:0,out:[],variabl:[],"3rd":6,open:[10,6],research:[],categori:[],vector:0,calib:[],calib_fil:[],red:0,fig_w:[],bathymetri:0,differ:6,gridwithnan_adcp:0,org:7,"byte":[],care:10,angl:0,unwant:[],keep:[],filter:[10,6],caption:[],length:[],radialconfigs_stf2_20130206_bapm_music402002_nosmooth:[],onto:0,first:6,origin:[10,6],softwar:6,rang:0,do_process_sort_pol:[7,6],currentshfrwithaverageexport:3,number:[],sometim:10,compsnewcalib_radialvelo_adcp_pao_sept2013:0,lat:[],done:6,lat_mid:[],miss:10,given:[0,6],script:[0,7,3,6],system:[7,3],spectraseri:10,saint:8,gpx:6,store:[0,10,6],shell:[7,3,6],travail:3,option:[],season:[],calib_hr:[],copi:[10,3,6],specifi:[0,6],part:1,than:[0,7],png:0,center:[],stf:[10,3],provid:3,remov:[10,6],delta_phase_th:[],structur:0,project:[0,1],xlabel:[],were:[8,6],posit:0,minut:[0,3,6],toward:[],submesoscal:6,seri:[],latitud:[],hfr:[],comput:[0,3],adcp_pao_version5adcpcorrected_newcalibrations_v2:0,julian:[7,6],ant:[],raw:[7,6],"20d":10,have:[10,7,6],need:[10,6],ismer:1,calib_min:[],min:3,centimet:[],superimpos:[0,6],note:6,also:10,ideal:10,gps_data:[],take:6,which:6,data1:[7,6],data2:7,sure:10,track:6,calibration_pao_29oct2014:6,seasond:10,marin:1,ogsl_hfr_treat:3,deploi:8,phase:10,everyth:10,do_filetransferssh:6,clear:[],doe:[10,3],azimuth:0,left:0,radial2uv:10,calib_year:[],gps_gpx2mat:6,filetransferssh:6,find:[0,1,7,6],fichier:0,onli:[0,10],locat:[7,3,6],calibration_pao:6,phasedifference_:[],calibration_pab:6,should:[7,6],theme:[],analyz:0,elseif:[],folder:[10,7,6],u_mean_adcp:0,local:10,oct:6,info:1,calib_tim:[],flament:6,variou:8,get:[0,10],yadcp:0,ssh:[7,3],adcp:[],version5_pao_ol_nofullc:7,wera_new_calibr:6,index_timecalib:[],ascii2mat:3,organ:1,helzelpao_track_29:6,common:6,contain:[0,6],rfi:[7,6],wiki:6,set:[],incid:[],ftp_transfer:7,matlab_analysi:[],see:6,sec:[],result:[0,7,3],close:[],"55min":3,best:[],patt:6,rad2deg:[],paocalibr:[],forecast:1,figur:0,between:1,theta:0,betwen:0,"15e6":[],isol:[],southeast:[],extent:7,subfold:7,bodi:[],last:3,delimit:[],helzel:6,umean_adcp_v:0,umean_adcp_u:0,april:7,calibration_pab_30oct2014:6,caibrat:[],"15min":0,improv:1,whole:0,load:0,point:[],color:[],css_:10,period:0,walk:6,header:10,drogu:8,diff:0,zeta:[],boat:6,coupl:1,instrument:[8,6],come:10,loggin:[10,7,6],due:6,been:[10,6],compon:0,much:7,interest:[0,10],download_wera_rt:3,delet:10,imag:[],radialconfig:[10,6],convert:[7,3,6],coordin:[0,6],togeth:3,calib_valu:[],"_calibr":[],look:[0,6],"_pair":[],"while":6,observ:3,loop:[10,6],metric:6,site:[0,7,3,10],archiv:[10,3],calibrationpao:6,calibrationpab:6,ascii:3,rfi0:6,pap:[10,3,6],dataconvers:[],etc:6,media:[0,7],make:[0,10],belong:6,sqrt:[],pab:[0,7,3],meridion:0,northwest:[],meopar_marion:[],num2str:[],fill:10,pao:[0,7,3],phi:[],http:3,webserv:3,closest:0,patt_pap1_2012_12_15:6,sort0:6,radialconfigs_pap1_20130201_bapm_music402002_20dsmooth:10,php:[],lower:8,appropri:10,kept:3,hfr_process:3,well:6,exampl:[0,10,7,6],thi:[0,1,3,8,6],choos:0,undertaken:6,model:1,bandet:[],usual:0,distanc:0,identifi:7,ddist:[],calibr:[],dyndn:7,wee:[],had:8,theoret:[],desktop:10,fortran:6,add:10,lawrenc:8,els:[],save:[10,6],modul:[],bin:[0,7,6],march:[10,6],fname:[],format:3,phasang:[],grid:[0,3],know:6,radiallst2uv:7,paperunit:[],measur:10,"_rx_coord":[],like:[],hfrdata:3,rangeadcp:0,spectraprocess:10,server:[7,3,10,6],collect:6,either:0,output:7,page:[1,6],r500:[],www:3,right:0,old:[],codarprocess:[],"1st":6,back:10,weraphase_txt2mat:6,sampl:8,home:[7,3,6],rsync:7,txt:[10,6],dlmwrite:[],markerfacecolor:[],avoid:[],"2014_10":6,per:7,seagatewireless:[0,7],estim:0,larg:6,outil:6,refer:6,run:[0,7,3,10,6],accueil:[],radial:[],delta_r:[],modsym:[],step:[],ruv:[10,3],"20132440000_pao":0,simpler:7,comparison:[],about:1,nanmean:[],bandma01:[0,7],column:[8,6],codar_wera_ogsl:3,strcmp:[],degre:[0,6],srv:3,mean:0,routin:[3,6],figdir:[],within:0,automat:[10,6],pair:[],vr_adcp_proj:0,weather:[],phasecalibration_:[],your:[],helzelpab_track_30:6,pabcalibr:[],span:[],log:3,transfer:[10,6],lon:[],transform:[10,6],changenam:6,avail:[0,3,6],start:[10,6],call:6,r_mid:[],link:6,yyyyjjj:7,do_postprocess_sort_newcalib:6,line:10,adcpbin2vspaosept2013:0,patt_pap1_2014_01_14_1154_nosmooth:10,codardata:10,made:[],save_flag:[],smooth:[10,6],displai:3,until:6,delta_phase_ob:[],record:6,below:1,sum:[],crad_pol_lst:7,"export":3,radialconfigs_pap1_20130201_bapm_music402002_nosmooth:[10,6],creat:[10,6],"48h":0,"int":[],ddsit:[],dpng:[],file:[10,7],pap1:[],check:[],ur_adcp_proj:0,antenna:[10,6],titl:[],nan:[],weraprocess:[],field:[1,6],other:1,futur:6,papers:[],you:[1,7,10],trash:10,relat:1,symbol:6,drift:[0,1],meaning:0,dropbox:[],calib_jd:[],xadcp:0,longitud:[],phi_ant:[],nfile:[],algorithm:0,directori:[3,6],htdoc:3,orientationpaosept2013:0,buoi:[1,8],depth:8,matfil:3,time:0},objtypes:{},objnames:{},filenames:["Comparison_WERA-ADCP_Sept2013","index","20130826","CurrentsCombination","20130830","20130515","calibration","WERAprocessing","20140506","calibPAB","CODARprocessing","calibPAO"],titles:["Comparison WERA and ADCP radial velocities September 2013","Welcome to the documentation of High Frequency Radars (CODAR and WERA)","Experiment on August 26, 2013","Current combination and OGSL data feed","Experiment on August 20, 2013","Experiment on May 15, 2013","Calibrations","WERA radial currents processing","Experiment on May 06, 2014","Outputs of WERAcalibration.m for PAB site","CODAR radial currents processing","Outputs of WERAcalibration.m for PAO site"],objects:{},titleterms:{feed:3,calibr:6,old:6,point:6,process:[10,7,6],direct:0,indic:[],high:1,radar:1,result:[],file:[],tabl:[],pap1:[],check:[],from:6,welcom:1,pere:6,pab:9,current:[7,3,10,6],quasi:[],postprocess:1,conduct:[],weracalibr:[11,9],"new":6,lsle:[],document:1,codar:[1,10,6],pao:11,analysi:[],saint:6,august:[2,4],comparison:[0,6],gener:6,object:6,ogsl:3,step:6,stf2:[],adcp:0,flavi:6,phase:6,post:[],now:6,data:3,radialconfigs_stf2_20121220_bapm_music402002_nosmooth:[],utc:6,experi:[1,2,5,8,4],radialconfigs_pap1_20121213_wapm_music402002_5dsmooth:[],frequenc:1,veloc:0,hfr:0,list:[],documentation_hfr_analysi:[],wera:[0,1,7,6],combin:3,mai:[5,8],radial:[0,10,7,6],site:[11,9],output:[11,9],realtim:[],septemb:0}})
3 3 \ No newline at end of file
... ...
source/calibration.rst
... ... @@ -79,8 +79,8 @@ Go to the **&quot;Submesoscale&quot;** `wiki`_ and click on &quot;useful links&quot; under **Outils*
79 79  
80 80  
81 81  
82   -Steps to generate new calibration file
83   -*****************************************
  82 +1. Steps to generate new calibration phases
  83 +*********************************************
84 84  
85 85 #. loggin to the wera server wera@132.215.11.14
86 86 #. cd etc/
... ... @@ -109,14 +109,15 @@ The tracks can be found in :
109 109 - /hfr-data-processing/calibrations/PAB/FlamentPAB_Track_30-OCT-14 182008.gpx
110 110  
111 111 We use the routine **GPS_gpx2mat.m** to convert .gpx files into .mat files.
  112 +
112 113 We use the routine **WERA_AntennaCoord_txt2mat.m** to transform the .txt files with antennas'coordinates to .mat files.
  114 +
113 115 We use the routine **WERAphase_txt2mat.m** to convert the .txt files containing phases into .mat files.
114 116  
115 117 The routine **WERAcalibration.m** is available at this `page`_.
116 118  
117 119 .. _page: WERAcalibration.html
118 120  
119   -
120 121 All the Matlab routines used for the data processing are located in **~/hfr-data-processing/calibrations/**.
121 122  
122 123  
... ... @@ -125,7 +126,7 @@ Outputs of **WERAcalibration.m** for PAO site are available here: `calibrationPA
125 126 .. _calibrationPAO: calibPAO.html
126 127  
127 128 +---------------------------------------------+
128   -| PAO - Helzel |
  129 +| PAO - Helzel- Phases in degrees |
129 130 +-------------+-----------------+-------------+
130 131 | Antenna nb | original phase | new phase |
131 132 +=============+=================+=============+
... ... @@ -154,14 +155,16 @@ Outputs of **WERAcalibration.m** for PAO site are available here: `calibrationPA
154 155 | 12 | -9.7778 | 153.9098 |
155 156 +-------------+-----------------+-------------+
156 157  
  158 +The new phase values were saved under **calibration_pao_29OCT2014.wera**.
157 159  
  160 +
158 161 Outputs of WERAcalibration.m for PAB site are available here: `calibrationPAB`_
159 162  
160 163 .. _calibrationPAB: calibPAB.html
161 164  
162 165  
163 166 +---------------------------------------------+
164   -| PAB - Helzel |
  167 +| PAB - Helzel - Phases in degrees |
165 168 +-------------+-----------------+-------------+
166 169 | Antenna nb | original phase | new phase |
167 170 +=============+=================+=============+
... ... @@ -190,40 +193,51 @@ Outputs of WERAcalibration.m for PAB site are available here: `calibrationPAB`_
190 193 | 12 | -2.7529 | 7.4966 |
191 194 +-------------+-----------------+-------------+
192 195  
  196 +The new phase values were saved under **calibration_pab_30OCT2014.wera**.
193 197  
194 198  
195 199  
196 200  
197   -Re-processing of radial currents with new phases
  201 +2. Re-processing of radial currents with new phases
198 202 ***************************************************
199 203  
200   -For the all month of September 2013, we are going to generate new files using the new calibration phases.
  204 +For the all month of September 2013, we are going to generate new radial currents using the new calibration phases.
201 205  
202   -Post-processing of WERA radial currents is documented `here`_.
  206 +Common steps for the post-processing of WERA radial currents is documented `here`_.
203 207  
204 208 .. _here: WERAprocessing.html
205 209  
206   -For example, let us see what we have to do to generate radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):
207 210  
208   -Data in the ~/data1/PAO/2013244/raw/ folder are converted in .SORT and .RFI in the ~/data1/PAO/2013244/results/ folder using the **do_process_SORT_pol** shell script. These files are generated using the "original" calibration phases.
  211 +For example, let us see what we have to do to generate new radial currents at PAO using the new calibration phases for september 1st, 2013 (Julian day 244):
  212 +
  213 + - loggin to the wera server
  214 +
  215 + - go to the folder containing the data:
  216 +
  217 + . cd ~/data1/PAO/2013244/
  218 + . the raw currents are located in **2013244/raw/**
  219 + . the analysis takes the raw currents, apply the calibration phases and save the resulting radial currents in **/2013244/results/** under .SORT and .RFI files using the **do_process_SORT_pol** shell script. This is done using the original calibration phases.
  220 + . the new radial currents using the updated calibration phases will be saved under **/2013244/results/new**.
209 221  
210 222  
211 223  
212   -First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script **changeName.sh** located in /hfr-data-processing/postprocessing/wera/.
  224 + - First we need to change the original .SORT and .RFI files and save them to .SORT0 and .RFI0 to save them for future reference. This is done with the shell script **changeName.sh** located in **/hfr-data-processing/postprocessing/wera/**.
213 225  
214   -.SORT====> .SORT0 (generated with original calibration)
215   -.RFI ====> .RFI0
  226 + - then we need to create a symbolic link to specify with files to use in terms of calibration phases. This file is different for each site.
216 227  
  228 + For the example taken here (site = PAO): calibration.wera.apply ---> calibration_pao_29OCT2014.wera and calibration.wera.remove -----> calibration_pao.wera
217 229  
218 230  
  231 + - then we need to run **MODIFY_WERA_SORT** to generate new .SORT and .RFI files using the new calibration phases.
219 232  
220   -as well as 2 symbolic links to point towards which file is the calibration to remove (with link calibration.wera.remove) and which file is the calibration to use (with link calibration.wera.apply).
  233 +All these steps are done in a shell script **do_postprocess_SORT_newCalib.sh** that calls **wera_new_calibration.sh**.
  234 +
221 235  
  236 +Large data files transfer has been automatized in **do_filetransferssh.sh** that calls **fileTransferSSH.sh**.
  237 +
  238 +All the shell scripts are located on the WERA server under **/home/wera/bin/**.
222 239  
223   -If we look at what the content of the calibration file is:
224   - * cat calibration_pab.wera
225 240  
226   -We want to compare the value of the phase given in the 3rd column with the one that we compute.
227 241  
228 242  
229 243  
... ...
source/index.rst
... ... @@ -22,6 +22,7 @@ Documentation about the steps of the analysis
22 22 WERAprocessing
23 23 calibration
24 24 calibPAO
  25 + calibPAB
25 26 Comparison_WERA-ADCP_Sept2013
26 27 CurrentsCombination
27 28  
... ...