Commit 39ceec07 authored by Marion Bandet's avatar Marion Bandet

update

parent 001ffce4
This diff is collapsed.
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Current combination &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: './',
VERSION: '0.0.1',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="OGSL quasi-realtime data feed" href="OGSL.html" />
<link rel="prev" title="WERA POST=PROCESSING" href="WERA_processing.html" />
</head>
<body>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="OGSL.html" title="OGSL quasi-realtime data feed"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="WERA_processing.html" title="WERA POST=PROCESSING"
accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
<div class="section" id="current-combination">
<h1>Current combination<a class="headerlink" href="#current-combination" title="Permalink to this headline"></a></h1>
<p>Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour.
The processing is conducted on the WERA server (ssh <a class="reference external" href="mailto:wera&#37;&#52;&#48;132&#46;215&#46;11&#46;14">wera<span>&#64;</span>132<span>&#46;</span>215<span>&#46;</span>11<span>&#46;</span>14</a>) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (<a class="reference external" href="http://ogsl.ca/observations/">http://ogsl.ca/observations/</a>).</p>
<p>All the matlab scripts are located in ~/projets/hfr_data_processing/hfr_processing.</p>
<p>A crontab runs the analysis (crontab).</p>
<p>The processing runs as follows:</p>
<p>&#8216;&#8217;&#8216;1- download the last available data at WERA sites&#8217;&#8216;&#8217; (radial currents - ascii format)</p>
<p>For PAO, data is available at HH+00 and HH+30</p>
<p>For PAB, data is available at HH+15 et HH+45</p>
<p>Every 10 min the crontab tries to download data via a shell script:</p>
<p>5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh</p>
<p>The data is located in: /home/wera/codar_wera_ogsl/archives/data</p>
<p>&#8216;&#8217;&#8216;2- download the last available data at CODAR sites&#8217;&#8216;&#8217; (.ruv)</p>
<p>For PAP and STF, data is available at HH+00</p>
<p>Every 5 minutes, the crontab tries to download data via a shell script:</p>
<p>0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh</p>
<p>The data is located in: /home/wera/codar_wera_ogsl/archives/data</p>
<p>&#8216;&#8217;&#8216;3-&#8216;&#8217;&#8217; at H+55min the crontab runs to &#8216;&#8217;&#8216;combine currents for the last hour&#8217;&#8216;&#8217; via a shell script:</p>
<p>55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh</p>
<p>What does the shell do?</p>
<p>1- copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail</p>
<p>2- unzip .gz files</p>
<p>3- convert .ruv to .mat format (ruv2mat)</p>
<p>4- convert ascii to .mat format (ascii2mat)</p>
<p>5- generate (combine) total currents (rad2tot)</p>
<p>At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour.</p>
<p>6- the routine currentsHfrWithAverageExport.m computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.</p>
<p>7- the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)</p>
</div>
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h4>Previous topic</h4>
<p class="topless"><a href="WERA_processing.html"
title="previous chapter">WERA POST=PROCESSING</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="OGSL.html"
title="next chapter">OGSL quasi-realtime data feed</a></p>
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="_sources/CurrentsCombination.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="OGSL.html" title="OGSL quasi-realtime data feed"
>next</a> |</li>
<li class="right" >
<a href="WERA_processing.html" title="WERA POST=PROCESSING"
>previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="footer">
&copy; Copyright 2015, Marion Bandet.
Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.2.3.
</div>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>OGSL quasi-realtime data feed &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: './',
VERSION: '0.0.1',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="Experiment on May 15, 2013" href="20130515.html" />
<link rel="prev" title="Current combination" href="CurrentsCombination.html" />
</head>
<body>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="20130515.html" title="Experiment on May 15, 2013"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination"
accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
<div class="section" id="ogsl-quasi-realtime-data-feed">
<h1>OGSL quasi-realtime data feed<a class="headerlink" href="#ogsl-quasi-realtime-data-feed" title="Permalink to this headline"></a></h1>
</div>
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h4>Previous topic</h4>
<p class="topless"><a href="CurrentsCombination.html"
title="previous chapter">Current combination</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="20130515.html"
title="next chapter">Experiment on May 15, 2013</a></p>
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="_sources/OGSL.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="20130515.html" title="Experiment on May 15, 2013"
>next</a> |</li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination"
>previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="footer">
&copy; Copyright 2015, Marion Bandet.
Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.2.3.
</div>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>&lt;no title&gt; &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: './',
VERSION: '0.0.1',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
</head>
<body>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="_sources/WEAR_processing.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="footer">
&copy; Copyright 2015, Marion Bandet.
Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.2.3.
</div>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>WERA POST=PROCESSING &mdash; documentation_HFR_analysis 0.0.1 documentation</title>
<link rel="stylesheet" href="_static/default.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT: './',
VERSION: '0.0.1',
COLLAPSE_INDEX: false,
FILE_SUFFIX: '.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="_static/jquery.js"></script>
<script type="text/javascript" src="_static/underscore.js"></script>
<script type="text/javascript" src="_static/doctools.js"></script>
<link rel="top" title="documentation_HFR_analysis 0.0.1 documentation" href="index.html" />
<link rel="next" title="Current combination" href="CurrentsCombination.html" />
<link rel="prev" title="CODAR post-processing" href="CODAR_processing.html" />
</head>
<body>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="CODAR_processing.html" title="CODAR post-processing"
accesskey="P">previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body">
<div class="section" id="wera-post-processing">
<h1>WERA POST=PROCESSING<a class="headerlink" href="#wera-post-processing" title="Permalink to this headline"></a></h1>
<p>Post-processing of WERA radial currents is much simpler than for the CODAR system.</p>
<p>The WERA system outputs data in folders identified by the year and Julian day (for example 2014101 for April 11, 2014).</p>
<p>In each folder we find .RFI and .SORT files for every hour (should find 24 files of each extention per day).</p>
<p>Use the shell script do_process_SORT_pol to generate .crad_pol_lst files. They will be found in the subfolder YYYYJJJ/results/.</p>
<p><a href="#id1"><span class="problematic" id="id2">**</span></a>** Use radiallst2uv.m to convert lst 2 mat files (To be verified).****</p>
<p>To download radial currents from the sites:</p>
<p>rsync -v -e ssh <a class="reference external" href="mailto:wera&#37;&#52;&#48;wera-lsle-pao&#46;dyndns&#46;org">wera<span>&#64;</span>wera-lsle-pao<span>&#46;</span>dyndns<span>&#46;</span>org</a>:/home/wera/data/ftp_transfer/${DATE}${HEURE}*_ascii* .</p>
<p>with i.e DATE=2015121 (yyyyJJJ) and HEURE =0100</p>
</div>
</div>
</div>
</div>
<div class="sphinxsidebar">
<div class="sphinxsidebarwrapper">
<h4>Previous topic</h4>
<p class="topless"><a href="CODAR_processing.html"
title="previous chapter">CODAR post-processing</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="CurrentsCombination.html"
title="next chapter">Current combination</a></p>
<h3>This Page</h3>
<ul class="this-page-menu">
<li><a href="_sources/WERA_processing.txt"
rel="nofollow">Show Source</a></li>
</ul>
<div id="searchbox" style="display: none">
<h3>Quick search</h3>
<form class="search" action="search.html" method="get">
<input type="text" name="q" />
<input type="submit" value="Go" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
<p class="searchtip" style="font-size: 90%">
Enter search terms or a module, class or function name.
</p>
</div>
<script type="text/javascript">$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="CurrentsCombination.html" title="Current combination"
>next</a> |</li>
<li class="right" >
<a href="CODAR_processing.html" title="CODAR post-processing"
>previous</a> |</li>
<li><a href="index.html">documentation_HFR_analysis 0.0.1 documentation</a> &raquo;</li>
</ul>
</div>
<div class="footer">
&copy; Copyright 2015, Marion Bandet.
Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.2.3.
</div>
</body>
</html>
\ No newline at end of file
You have to loggin to the CODAR server at UQAR.
Then follow the directions:
== Check processed data ==
Go to
'''CodarData/Codar/SeaSonde/Data/Spectra/SpectraProcessed'''
* check that all files have been processed
* If ok, remove all file (move to trash)
== RadialConfig ==
Go to
'''CodarData/Codar/SeaSonde/Configs/RadialConfigs'''
* Delete everything
Go to (for example)
'''CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth'''
* Copy the content of the folder into
'''CodarData/Codar/SeaSonde/Configs/RadialConfigs'''
CODAR post-processing
=====================
== Antenna diagrams for processing ==
Go to
'''CodarData/Codar/SeaSonde/Data/Loops/ PATT_PAP1_2014_01_14_1154_NoSmooth.xlp'''
Copy MeasPattern.txt and Phases.txt
Paste in
'''CodarData/Codar/SeaSonde/Configs/RadialConfigs'''
Open Header.txt and change line 19 if needed
save. (MUSIC parameters 40 20 2 or 80 40 1)
=='''ADD-ON Analysis on March 14, 2014'''==
Go to
'''CodarData/Codar/SeaSonde/Configs/RadialConfigs'''
Run “Seasonde Radial Site Setup”.
In “Advanced”, uncheck “filtered and filled” and check “filtered” only.
Save.
Copy the content of the folder RadialConfigs back to the original folder, for example if what is in the “/RadialConfigs” folder comes from “/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_20Dsmooth”, after running the “Seasonde Radial Site Setup”, copy the content of “/RadialConfigs” back to “/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_20Dsmooth”.
== Spectra ==
Go get spectra on disks (CODAR1 or CODAR2) (on desktop)
Go to (for example)
'''Codar2/PAP1/Archives/Spectra/'''
Copy the day(s) we are interested in
(Attention: copy the CSS_....cs4 files in PAP1_CSS_... folder!!)
and paste in
'''CodarData/Codar/SeaSonde/Data/Spectra/SpectraToProcess'''
==> Can also store spectra in
CodarData/Codar/SeaSonde/Data/Spectra/SpectraSeries
Before copy/paste in SpectraToProcess
Once the spectra are in SpectraToProcess, the analysis starts automatically!
ATTENTION: make sure all the files are copied in “SpectraToProcess” sometimes copy-paste does miss files….
== Retrieve processed data ==
Go to
'''CodarData/Codar/SeaSonde/Data/Radials/'''
Processed data are in “Filtered”, “IdealPattern” and “MeasPattern” folders.
Save data in appropriate folders (to be created if needs be)
MUSIC 40-20-2
*no smoothing
*measured no filtered
*ideal no filtered
*measured filtered
*ideal filtered
MUSIC 80-40-1
*no smoothing
*measured no filtered
*ideal no filtered
*measured filtered
*ideal filtered
MUSIC 40-20-2
*20D smoothing
*measured no filtered
*measured filtered
MUSIC 80-40-1
*20D smoothing
*measured no filtered
*measured filtered
== Transfer data to local disk ==
== Transform .ruv to .mat ==
Using radial2uv.m
Be careful to the flag f.
*f=0 for not filtered data;
*f=1 for filtered data
== CHECK_UP ==
{|
|
|
|
|
|PAP
|STF
|-
|1. measured
|MUSIC 40-20-2
|no smoothing
|no filtered
|ok
|ok
|-
|2. ideal
|MUSIC 40-20-2
|no smoothing
|no filtered
|ok
|ok
|-
|3. measured
|MUSIC 40-20-2
|no smoothing
|filtered
|ok
|ok
|-
|4. ideal
|MUSIC 40-20-2
|no smoothing
|filtered
|ok
|ok
|-
|5. measured
|MUSIC 80-40-1
|no smoothing
|no filtered
|ok
|ok
|-
|6. ideal
|MUSIC 80-40-1
|no smoothing
|no filtered
|ok
|ok
|-
|7. measured
|MUSIC 80-40-1
|no smoothing
|filtered
|ok
|ok
|-
|8. ideal
|MUSIC 80-40-1
|no smoothing
|filtered
|ok
|ok
|-
|9. measured
|MUSIC 40-20-2