Commit d001201d authored by Marion Bandet's avatar Marion Bandet

update

parent f1d33131
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Comparison WERA and ADCP radial velocities September 2013 &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: './',
VERSION: '0.0.1',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="Current combination and OGSL data feed" href="CurrentsCombination.html" />
<link rel="prev" title="WERA radial currents processing" href="WERAprocessing.html" />
</head>
<body>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination and OGSL data feed"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="WERAprocessing.html" title="WERA radial currents processing"
accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
<div class="section" id="comparison-wera-and-adcp-radial-velocities-september-2013">
<h1>Comparison WERA and ADCP radial velocities September 2013<a class="headerlink" href="#comparison-wera-and-adcp-radial-velocities-september-2013" title="Permalink to this headline"></a></h1>
<p>Matlab script used to do the analysis is <strong>RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m</strong></p>
<p>Steps of the algorithm:</p>
<p>1- we choose a site to analyze, either PAO (site 1) or PAB (site 2)</p>
<p>2- we load the bathymetry and the HFR sites&#8217;coordinates</p>
<p>3- we specify if we use the &#8220;old&#8221; or &#8220;new&#8221; calibrations. Usually &#8220;New&#8221;.</p>
<p>4- we load IML-4 ADCP data (2013) and gps data</p>
<p>5- we make a list of all the HFR files available for the site of interest.</p>
<p>6- we analyze the ADCP data (bin 2 only to get near-surface data):</p>
<blockquote>
<div><p>We look for the indices of the ADCP time vector corresponding to the time period of interest (here 01 to 30 September 2013).</p>
<p>For each index, we look for the ADCP position (xadcp,yadcp)(via the gps coordinates).</p>
<p>We then look for the positions 15min before and 15min after.</p>
<p>We estimate the mean drift of the ADCP within these 30 minutes (Umean_adcp_u, Umean_adcp_v and U_mean_adcp (total)).</p>
<p>We find the radial orientation at the ADCP position given by xadcp,yadcp: azimuth in degrees from HFR site to adcp position</p>
<p>We project U_mean_adcp onto the radial direction to get the radial current components (ur_adcp_proj, vr_adcp_proj).</p>
<p>We store all the meaningful parameters into a structure named adcp.</p>
</div></blockquote>
<p>7- We analyze the HFR data:</p>
<blockquote>
<div><p>We look for the indices of the HFR time vector corresponding to the time period of interest (here 01 to 30 September 2013)</p>
<p>For each index, we load the corresponding HFR file (i.e. 20132440000_pao.mat). Each file contains a grid (X,Y) with radial currents at each grid point (Ur), a corresponding time vector (t) and the angle and distance from the site (theta,r).</p>
</div></blockquote>
<div class="figure align-center">
<img alt="_images/Radial_ADCPbin2_HFR_PAO_version5_Sept2013.png" src="_images/Radial_ADCPbin2_HFR_PAO_version5_Sept2013.png" />
<p class="caption">Hourly radial currents from ADCP bin 2 and HFR WERA at PAO - September 2013</p>
<div class="legend">
Superimposed are the 48-h averages</div>
</div>
<p>[[Fichier:gridwithnan_adcp.png]]</p>
<blockquote>
<div><p>We find the HFR Radial velocity at this position and project it onto zonal and meridional components.</p>
<p>We store all the meaningful parameters into a structure named radar.</p>
</div></blockquote>
<p>This analysis allows us to compare radial velocity components from each HFR site with the ADCP components.</p>
</div>
<div class="section" id="hfr-direction">
<h1>HFR direction<a class="headerlink" href="#hfr-direction" title="Permalink to this headline"></a></h1>
<p>To verify that the HFR looks in the right direction:</p>
<p>For each time step of the time period of interest, we compute the distance from the HFR site to each grid point. We select the grid points that are at the same range from the HFR site than the grid point closest to the ADCP.</p>
<p>[[Fichier:rangeADCP.png]]</p>
<p>For each of these grid point (in cyan in the figure), we compute the azimuth the the site coordinates and we extract the radial velocity (total) and its components (zonal and meridional).</p>
<p>We store all the meaningful parameters into a structure named range.</p>
<p>Results from the whole analysis are stored, for example, under:
/run/media/bandma01/SeagateWireless/MEOPAR/Matlab/Analysis/Radial_Comparison/201309/ADCP-PAO/ADCP_PAO_version5adcpCorrected_newcalibrations_v2.mat</p>
<p>[[Fichier:CompsNewCalib_RadialVelo_ADCP_PAO_Sept2013.png|200px|thumb|left|Comparison of radial velocities from ADCP bin 2 and HFR WERA at PAO site September 2013]]</p>
<p>[[Fichier:orientationPAOSept2013.png|200px|thumb|left|RMS diff and correlation from radial velocities compared betwen ADCP bin 2 and HFR WERA at PAO site September 2013]]</p>
<p>[[Fichier:ADCPbin2vsPAOSept2013.png|200px|thumb|left|radial velocities from ADCP bin 2 vs HFR WERA at PAO site September 2013 - in red: 48h averages]]]]</p>
</div>
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h3><a href="index.html">Table Of Contents</a></h3>
<ul>
<li><a class="reference internal" href="#">Comparison WERA and ADCP radial velocities September 2013</a></li>
<li><a class="reference internal" href="#hfr-direction">HFR direction</a></li>
</ul>
<h4>Previous topic</h4>
<p class="topless"><a href="WERAprocessing.html"
title="previous chapter">WERA radial currents processing</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="CurrentsCombination.html"
title="next chapter">Current combination and OGSL data feed</a></p>
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="_sources/Comparison_WERA-ADCP_Sept2013.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination and OGSL data feed"
>next</a> |</li>
<li class="right" >
<a href="WERAprocessing.html" title="WERA radial currents processing"
>previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="footer">
&copy; Copyright 2015, Marion Bandet.
Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.2.3.
</div>
</body>
</html>
\ No newline at end of file
...@@ -6,7 +6,7 @@ ...@@ -6,7 +6,7 @@
<head> <head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Current combination &mdash; documentation_HFR_analysis 0.0.1 documentation</title> <title>Current combination and OGSL data feed &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" /> <link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" /> <link rel="stylesheet" href="_static/pygments.css" type="text/css" />
...@@ -24,8 +24,8 @@ ...@@ -24,8 +24,8 @@
<script type="text/javascript" src="_static/underscore.js"></script> <script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script> <script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" /> <link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="OGSL quasi-realtime data feed" href="OGSL.html" /> <link rel="next" title="Experiment on May 15, 2013" href="20130515.html" />
<link rel="prev" title="WERA POST=PROCESSING" href="WERA_processing.html" /> <link rel="prev" title="Comparison WERA and ADCP radial velocities September 2013" href="Comparison_WERA-ADCP_Sept2013.html" />
</head> </head>
<body> <body>
<div class="related"> <div class="related">
...@@ -35,10 +35,10 @@ ...@@ -35,10 +35,10 @@
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
accesskey="I">index</a></li> accesskey="I">index</a></li>
<li class="right" > <li class="right" >
<a href="OGSL.html" title="OGSL quasi-realtime data feed" <a href="20130515.html" title="Experiment on May 15, 2013"
accesskey="N">next</a> |</li> accesskey="N">next</a> |</li>
<li class="right" > <li class="right" >
<a href="WERA_processing.html" title="WERA POST=PROCESSING" <a href="Comparison_WERA-ADCP_Sept2013.html" title="Comparison WERA and ADCP radial velocities September 2013"
accesskey="P">previous</a> |</li> accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li> <li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul> </ul>
...@@ -49,35 +49,49 @@ ...@@ -49,35 +49,49 @@
<div class="bodywrapper"> <div class="bodywrapper">
<div class="body"> <div class="body">
<div class="section" id="current-combination"> <div class="section" id="current-combination-and-ogsl-data-feed">
<h1>Current combination<a class="headerlink" href="#current-combination" title="Permalink to this headline"></a></h1> <h1>Current combination and OGSL data feed<a class="headerlink" href="#current-combination-and-ogsl-data-feed" title="Permalink to this headline"></a></h1>
<p>Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour. <p>Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour.
The processing is conducted on the WERA server (ssh <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (<a class="reference external" href="http://ogsl.ca/observations/">http://ogsl.ca/observations/</a>).</p> The processing is conducted on the WERA server (ssh <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (<a class="reference external" href="http://ogsl.ca/observations/">http://ogsl.ca/observations/</a>).</p>
<p>All the matlab scripts are located in ~/projets/hfr_data_processing/hfr_processing.</p> <p>All the matlab scripts are located in ~/projets/hfr_data_processing/hfr_processing.</p>
<p>A crontab runs the analysis (crontab).</p> <p>A crontab runs the analysis (crontab).</p>
<p>The processing runs as follows:</p> <p>The processing runs as follows:</p>
<p>&#8216;&#8217;&#8216;1- download the last available data at WERA sites&#8217;&#8216;&#8217; (radial currents - ascii format)</p> <p>1- Download the last available data at each WERA sites (radial currents - ascii format)</p>
<p>For PAO, data is available at HH+00 and HH+30</p> <blockquote>
<p>For PAB, data is available at HH+15 et HH+45</p> <div><p>For PAO, data is available at HH+00 and HH+30.</p>
<p>For PAB, data is available at HH+15 et HH+45.</p>
<p>Every 10 min the crontab tries to download data via a shell script:</p> <p>Every 10 min the crontab tries to download data via a shell script:</p>
</div></blockquote>
<p>5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh</p> <p>5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh</p>
<p>The data is located in: /home/wera/codar_wera_ogsl/archives/data</p> <blockquote>
<p>&#8216;&#8217;&#8216;2- download the last available data at CODAR sites&#8217;&#8216;&#8217; (.ruv)</p> <div>The data is located in: /home/wera/codar_wera_ogsl/archives/data</div></blockquote>
<p>For PAP and STF, data is available at HH+00</p> <p>2- Download the last available data at each CODAR sites (.ruv)</p>
<blockquote>
<div><p>For PAP and STF, data is available at HH+00</p>
<p>Every 5 minutes, the crontab tries to download data via a shell script:</p> <p>Every 5 minutes, the crontab tries to download data via a shell script:</p>
</div></blockquote>
<p>0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh</p> <p>0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh</p>
<p>The data is located in: /home/wera/codar_wera_ogsl/archives/data</p> <blockquote>
<p>&#8216;&#8217;&#8216;3-&#8216;&#8217;&#8217; at H+55min the crontab runs to &#8216;&#8217;&#8216;combine currents for the last hour&#8217;&#8216;&#8217; via a shell script:</p> <div>The data is located in: /home/wera/codar_wera_ogsl/archives/data</div></blockquote>
<p>3- at H+55min the crontab runs to combine currents for the last hour via a shell script:</p>
<p>55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh</p> <p>55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh</p>
<p>What does the shell do?</p> <p>What does the shell do?</p>
<p>1- copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail</p> <blockquote>
<p>2- unzip .gz files</p> <div><ol class="loweralpha simple">
<p>3- convert .ruv to .mat format (ruv2mat)</p> <li>copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail</li>
<p>4- convert ascii to .mat format (ascii2mat)</p> <li>unzip .gz files</li>
<p>5- generate (combine) total currents (rad2tot)</p> <li>convert .ruv to .mat format (<strong>ruv2mat.m</strong>)</li>
<li>convert ascii to .mat format (<strong>ascii2mat.m</strong>)</li>
<li>generate (combine) total currents (<strong>rad2tot.m</strong>)</li>
</ol>
</div></blockquote>
<p>At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour.</p> <p>At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour.</p>
<p>6- the routine currentsHfrWithAverageExport.m computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.</p> <blockquote>
<p>7- the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)</p> <div><ol class="loweralpha simple" start="6">
<li>the routine <strong>currentsHfrWithAverageExport.m</strong> computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.</li>
<li>the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)</li>
</ol>
</div></blockquote>
</div> </div>
...@@ -87,11 +101,11 @@ The processing is conducted on the WERA server (ssh <a class="reference external ...@@ -87,11 +101,11 @@ The processing is conducted on the WERA server (ssh <a class="reference external
<div class="sphinxsidebar"> <div class="sphinxsidebar">
<div class="sphinxsidebarwrapper"> <div class="sphinxsidebarwrapper">
<h4>Previous topic</h4> <h4>Previous topic</h4>
<p class="topless"><a href="WERA_processing.html" <p class="topless"><a href="Comparison_WERA-ADCP_Sept2013.html"
title="previous chapter">WERA POST=PROCESSING</a></p> title="previous chapter">Comparison WERA and ADCP radial velocities September 2013</a></p>
<h4>Next topic</h4> <h4>Next topic</h4>
<p class="topless"><a href="OGSL.html" <p class="topless"><a href="20130515.html"
title="next chapter">OGSL quasi-realtime data feed</a></p> title="next chapter">Experiment on May 15, 2013</a></p>
<h3>This Page</h3> <h3>This Page</h3>
<ul class="this-page-menu"> <ul class="this-page-menu">
<li><a href="_sources/CurrentsCombination.txt" <li><a href="_sources/CurrentsCombination.txt"
...@@ -121,10 +135,10 @@ The processing is conducted on the WERA server (ssh <a class="reference external ...@@ -121,10 +135,10 @@ The processing is conducted on the WERA server (ssh <a class="reference external
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
>index</a></li> >index</a></li>
<li class="right" > <li class="right" >
<a href="OGSL.html" title="OGSL quasi-realtime data feed" <a href="20130515.html" title="Experiment on May 15, 2013"
>next</a> |</li> >next</a> |</li>
<li class="right" > <li class="right" >
<a href="WERA_processing.html" title="WERA POST=PROCESSING" <a href="Comparison_WERA-ADCP_Sept2013.html" title="Comparison WERA and ADCP radial velocities September 2013"
>previous</a> |</li> >previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li> <li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul> </ul>
......
...@@ -6,7 +6,7 @@ ...@@ -6,7 +6,7 @@
<head> <head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>WERA POST=PROCESSING &mdash; documentation_HFR_analysis 0.0.1 documentation</title> <title>WERA radial currents processing &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" /> <link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" /> <link rel="stylesheet" href="_static/pygments.css" type="text/css" />
...@@ -24,7 +24,7 @@ ...@@ -24,7 +24,7 @@
<script type="text/javascript" src="_static/underscore.js"></script> <script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script> <script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" /> <link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="Current combination" href="CurrentsCombination.html" /> <link rel="next" title="Comparison WERA and ADCP radial velocities September 2013" href="Comparison_WERA-ADCP_Sept2013.html" />
<link rel="prev" title="CODAR radial currents processing" href="CODARprocessing.html" /> <link rel="prev" title="CODAR radial currents processing" href="CODARprocessing.html" />
</head> </head>
<body> <body>
...@@ -35,7 +35,7 @@ ...@@ -35,7 +35,7 @@
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
accesskey="I">index</a></li> accesskey="I">index</a></li>
<li class="right" > <li class="right" >
<a href="CurrentsCombination.html" title="Current combination" <a href="Comparison_WERA-ADCP_Sept2013.html" title="Comparison WERA and ADCP radial velocities September 2013"
accesskey="N">next</a> |</li> accesskey="N">next</a> |</li>
<li class="right" > <li class="right" >
<a href="CODARprocessing.html" title="CODAR radial currents processing" <a href="CODARprocessing.html" title="CODAR radial currents processing"
...@@ -49,8 +49,8 @@ ...@@ -49,8 +49,8 @@
<div class="bodywrapper"> <div class="bodywrapper">
<div class="body"> <div class="body">
<div class="section" id="wera-post-processing"> <div class="section" id="wera-radial-currents-processing">
<h1>WERA POST=PROCESSING<a class="headerlink" href="#wera-post-processing" title="Permalink to this headline"></a></h1> <h1>WERA radial currents processing<a class="headerlink" href="#wera-radial-currents-processing" title="Permalink to this headline"></a></h1>
<p>Post-processing of WERA radial currents is much simpler than for the CODAR system.</p> <p>Post-processing of WERA radial currents is much simpler than for the CODAR system.</p>
<p>The WERA system outputs data in folders identified by the year and Julian day (for example 2014101 for April 11, 2014).</p> <p>The WERA system outputs data in folders identified by the year and Julian day (for example 2014101 for April 11, 2014).</p>
<p>In each folder we find .RFI and .SORT files for every hour (should find 24 files of each extention per day).</p> <p>In each folder we find .RFI and .SORT files for every hour (should find 24 files of each extention per day).</p>
...@@ -71,8 +71,8 @@ ...@@ -71,8 +71,8 @@
<p class="topless"><a href="CODARprocessing.html" <p class="topless"><a href="CODARprocessing.html"
title="previous chapter">CODAR radial currents processing</a></p> title="previous chapter">CODAR radial currents processing</a></p>
<h4>Next topic</h4> <h4>Next topic</h4>
<p class="topless"><a href="CurrentsCombination.html" <p class="topless"><a href="Comparison_WERA-ADCP_Sept2013.html"
title="next chapter">Current combination</a></p> title="next chapter">Comparison WERA and ADCP radial velocities September 2013</a></p>
<h3>This Page</h3> <h3>This Page</h3>
<ul class="this-page-menu"> <ul class="this-page-menu">
<li><a href="_sources/WERAprocessing.txt" <li><a href="_sources/WERAprocessing.txt"
...@@ -102,7 +102,7 @@ ...@@ -102,7 +102,7 @@
<a href="genindex.html" title="General Index" <a href="genindex.html" title="General Index"
>index</a></li> >index</a></li>
<li class="right" > <li class="right" >
<a href="CurrentsCombination.html" title="Current combination" <a href="Comparison_WERA-ADCP_Sept2013.html" title="Comparison WERA and ADCP radial velocities September 2013"
>next</a> |</li> >next</a> |</li>
<li class="right" > <li class="right" >
<a href="CODARprocessing.html" title="CODAR radial currents processing" <a href="CODARprocessing.html" title="CODAR radial currents processing"
......
Comparison WERA and ADCP radial velocities September 2013
===============================================================
Matlab script used to do the analysis is **RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m**
Steps of the algorithm:
1- we choose a site to analyze, either PAO (site 1) or PAB (site 2)
2- we load the bathymetry and the HFR sites'coordinates
3- we specify if we use the "old" or "new" calibrations. Usually "New".
4- we load IML-4 ADCP data (2013) and gps data
5- we make a list of all the HFR files available for the site of interest.
6- we analyze the ADCP data (bin 2 only to get near-surface data):
We look for the indices of the ADCP time vector corresponding to the time period of interest (here 01 to 30 September 2013).
For each index, we look for the ADCP position (xadcp,yadcp)(via the gps coordinates).
We then look for the positions 15min before and 15min after.
We estimate the mean drift of the ADCP within these 30 minutes (Umean_adcp_u, Umean_adcp_v and U_mean_adcp (total)).
We find the radial orientation at the ADCP position given by xadcp,yadcp: azimuth in degrees from HFR site to adcp position
We project U_mean_adcp onto the radial direction to get the radial current components (ur_adcp_proj, vr_adcp_proj).
We store all the meaningful parameters into a structure named adcp.
7- We analyze the HFR data:
We look for the indices of the HFR time vector corresponding to the time period of interest (here 01 to 30 September 2013)
For each index, we load the corresponding HFR file (i.e. 20132440000_pao.mat). Each file contains a grid (X,Y) with radial currents at each grid point (Ur), a corresponding time vector (t) and the angle and distance from the site (theta,r).
.. figure:: ../../figures/RadialVelocities/ADCP/Radial_ADCPbin2_HFR_PAO_version5_Sept2013.png
:align: center
Hourly radial currents from ADCP bin 2 and HFR WERA at PAO - September 2013
Superimposed are the 48-h averages
.. [Fichier:Exple_allgridpt.png]] [[Fichier:Gridwithnan.png]]
We then look for the HFR grid point nearest the ADCP position at the time of interest.
[[Fichier:gridwithnan_adcp.png]]
We find the HFR Radial velocity at this position and project it onto zonal and meridional components.
We store all the meaningful parameters into a structure named radar.
This analysis allows us to compare radial velocity components from each HFR site with the ADCP components.
HFR direction
===============
To verify that the HFR looks in the right direction:
For each time step of the time period of interest, we compute the distance from the HFR site to each grid point. We select the grid points that are at the same range from the HFR site than the grid point closest to the ADCP.
[[Fichier:rangeADCP.png]]
For each of these grid point (in cyan in the figure), we compute the azimuth the the site coordinates and we extract the radial velocity (total) and its components (zonal and meridional).
We store all the meaningful parameters into a structure named range.
Results from the whole analysis are stored, for example, under:
/run/media/bandma01/SeagateWireless/MEOPAR/Matlab/Analysis/Radial_Comparison/201309/ADCP-PAO/ADCP_PAO_version5adcpCorrected_newcalibrations_v2.mat
[[Fichier:CompsNewCalib_RadialVelo_ADCP_PAO_Sept2013.png|200px|thumb|left|Comparison of radial velocities from ADCP bin 2 and HFR WERA at PAO site September 2013]]
[[Fichier:orientationPAOSept2013.png|200px|thumb|left|RMS diff and correlation from radial velocities compared betwen ADCP bin 2 and HFR WERA at PAO site September 2013]]
[[Fichier:ADCPbin2vsPAOSept2013.png|200px|thumb|left|radial velocities from ADCP bin 2 vs HFR WERA at PAO site September 2013 - in red: 48h averages]]]]
Current combination Current combination and OGSL data feed
=================== ==========================================
Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour. Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour.
The processing is conducted on the WERA server (ssh wera@132.215.11.14) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (http://ogsl.ca/observations/). The processing is conducted on the WERA server (ssh wera@132.215.11.14) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (http://ogsl.ca/observations/).
...@@ -10,49 +10,50 @@ A crontab runs the analysis (crontab). ...@@ -10,49 +10,50 @@ A crontab runs the analysis (crontab).
The processing runs as follows: The processing runs as follows:
'''1- download the last available data at WERA sites''' (radial currents - ascii format) 1- Download the last available data at each WERA sites (radial currents - ascii format)
For PAO, data is available at HH+00 and HH+30 For PAO, data is available at HH+00 and HH+30.
For PAB, data is available at HH+15 et HH+45 For PAB, data is available at HH+15 et HH+45.
Every 10 min the crontab tries to download data via a shell script: Every 10 min the crontab tries to download data via a shell script:
5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh 5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh
The data is located in: /home/wera/codar_wera_ogsl/archives/data The data is located in: /home/wera/codar_wera_ogsl/archives/data
..
'''2- download the last available data at CODAR sites''' (.ruv) 2- Download the last available data at each CODAR sites (.ruv)
For PAP and STF, data is available at HH+00 For PAP and STF, data is available at HH+00
Every 5 minutes, the crontab tries to download data via a shell script: Every 5 minutes, the crontab tries to download data via a shell script:
0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh 0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh
The data is located in: /home/wera/codar_wera_ogsl/archives/data The data is located in: /home/wera/codar_wera_ogsl/archives/data
..
3- at H+55min the crontab runs to combine currents for the last hour via a shell script:
'''3-''' at H+55min the crontab runs to '''combine currents for the last hour''' via a shell script:
55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh 55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh
What does the shell do? What does the shell do?
1- copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail a) copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail
2- unzip .gz files b) unzip .gz files
3- convert .ruv to .mat format (ruv2mat) c) convert .ruv to .mat format (**ruv2mat.m**)
4- convert ascii to .mat format (ascii2mat) d) convert ascii to .mat format (**ascii2mat.m**)
5- generate (combine) total currents (rad2tot) e) generate (combine) total currents (**rad2tot.m**)
At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour. At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour.
6- the routine currentsHfrWithAverageExport.m computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website. f) the routine **currentsHfrWithAverageExport.m** computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.
7- the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log) g) the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)
WERA POST=PROCESSING WERA radial currents processing
==================== ==================================
Post-processing of WERA radial currents is much simpler than for the CODAR system. Post-processing of WERA radial currents is much simpler than for the CODAR system.
......
...@@ -20,8 +20,8 @@ Documentation about the steps of the analysis ...@@ -20,8 +20,8 @@ Documentation about the steps of the analysis
CODARprocessing CODARprocessing
WERAprocessing WERAprocessing
Comparison_WERA-ADCP_Sept2013
CurrentsCombination CurrentsCombination
OGSL
......