Commit 06df0a3d9d4d065141b4668d25f5cb6ea9de6d55

Authored by Marion Bandet
1 parent 54a974a3
Exists in master

update

Showing 2 changed files with 22 additions and 21 deletions   Show diff stats
source/CurrentsCombination.rst
1   -Current combination
2   -===================
  1 +Current combination and OGSL data feed
  2 +==========================================
3 3  
4 4 Radial currents from WERA and CODAR systems are combined together on a grid to provide total currents approximately every hour.
5 5 The processing is conducted on the WERA server (ssh wera@132.215.11.14) and the resulting hourly currents are exported to .csv files to be displayed on he OGSL website (http://ogsl.ca/observations/).
... ... @@ -10,49 +10,50 @@ A crontab runs the analysis (crontab).
10 10  
11 11 The processing runs as follows:
12 12  
13   -'''1- download the last available data at WERA sites''' (radial currents - ascii format)
  13 +1- Download the last available data at each WERA sites (radial currents - ascii format)
14 14  
15   -For PAO, data is available at HH+00 and HH+30
  15 + For PAO, data is available at HH+00 and HH+30.
16 16  
17   -For PAB, data is available at HH+15 et HH+45
  17 + For PAB, data is available at HH+15 et HH+45.
18 18  
19   -Every 10 min the crontab tries to download data via a shell script:
  19 + Every 10 min the crontab tries to download data via a shell script:
20 20  
21 21 5,15,25,35,45,50 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_wera_rt.sh
22 22  
23   -The data is located in: /home/wera/codar_wera_ogsl/archives/data
  23 + The data is located in: /home/wera/codar_wera_ogsl/archives/data
24 24  
  25 +..
25 26  
26   -'''2- download the last available data at CODAR sites''' (.ruv)
  27 +2- Download the last available data at each CODAR sites (.ruv)
27 28  
28   -For PAP and STF, data is available at HH+00
  29 + For PAP and STF, data is available at HH+00
29 30  
30   -Every 5 minutes, the crontab tries to download data via a shell script:
  31 + Every 5 minutes, the crontab tries to download data via a shell script:
31 32  
32 33 0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/download_codar_rt.sh
33 34  
34   -The data is located in: /home/wera/codar_wera_ogsl/archives/data
  35 + The data is located in: /home/wera/codar_wera_ogsl/archives/data
35 36  
  37 +..
36 38  
37   -
38   -'''3-''' at H+55min the crontab runs to '''combine currents for the last hour''' via a shell script:
  39 +3- at H+55min the crontab runs to combine currents for the last hour via a shell script:
39 40  
40 41 55 * * * * /home/wera/projets/hfr-data-processing/hfr_process/ogsl_hfr_treatment.sh
41 42  
42 43 What does the shell do?
43 44  
44   -1- copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail
  45 + a) copy the .ruv and ascii files located in /home/wera/codar_wera_ogsl/archives/data in the working directory /home/wera/codar_wera_ogsl/travail
45 46  
46   -2- unzip .gz files
  47 + b) unzip .gz files
47 48  
48   -3- convert .ruv to .mat format (ruv2mat)
  49 + c) convert .ruv to .mat format (**ruv2mat.m**)
49 50  
50   -4- convert ascii to .mat format (ascii2mat)
  51 + d) convert ascii to .mat format (**ascii2mat.m**)
51 52  
52   -5- generate (combine) total currents (rad2tot)
  53 + e) generate (combine) total currents (**rad2tot.m**)
53 54  
54 55 At this stage a .mat file is generated (i.e. HFR_LSLE_20150817T170000Z.mat) for each hour.
55 56  
56   -6- the routine currentsHfrWithAverageExport.m computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.
  57 + f) the routine **currentsHfrWithAverageExport.m** computes the 25-hour current average and exports the hourly currents into a .csv file to be displayed on the OGSL website.
57 58  
58   -7- the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)
  59 + g) the .csv files are moved to the webserver (/srv/www/htdocs/wera/hfrdata) and the .mat are moved in archives (/home/wera/codar_wera_ogsl/archives/matfiles and /srv/www/htdocs/wera/hfrmat) and logs are kept in /home/wera/codar_wera_ogsl/logs (download_codar_rt.log, download_wera_rt.log, ogsl_hfr_treatment.log, reprocess_ogsl_hfr_treatment.log)
... ...
source/WERAprocessing.rst
1   -WERA POST=PROCESSING
  1 +WERA POST-PROCESSING
2 2 ====================
3 3  
4 4 Post-processing of WERA radial currents is much simpler than for the CODAR system.
... ...