dailylog.rst 4.53 KB

Log Work Marion

19 OCT 2015:

  • IBM data management request (IBMassessment.odf)

  • regenerate new calibration_pao_29OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO

  • regenerate new calibration_pab_30OCT2014.wera located in /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB

  • transfer files via ssh to WERA srv:
    • rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAB/calibration_pab_30OCT2014.wera wera@132.215.11.14:~/etc/
    • rsync -v -e ssh /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/calibration_pao_29OCT2014.wera wera@132.215.11.14:~/etc/

20 OCT 2015:

reprocess calibrations with new, corrected phases:

  • log onto wera server

  • cd data1/PAO/

  • create a directory 2013244_bkp to run test

  • rsync -aud 2013244/ 2013244_bkp/

  • cd 2013244

  • what to do?
    • cd /home/wera/bin

    • vi do_postprocess_SORT_newCalib.sh

      => add lines 89 nd 90 rm .SORT, rm .RFI

    • wera_new_calibration.sh

      => comment lines 28-32 (mv .SORT to SORT0 and .RFI to .RFI0)

  • try on 2013244: > bash -x do_postprocess_SORT_newCalib -s PAO -y 2013244

  • to process more than one day at a time, use:> bash -x Process_TimePeriod_wera.sh -s PAO -d 2013245 -f 2013273

  • files transfer (PAO) using shell script in /home/wera/bin: do_filetransferssh.sh

21 OCT 2015:

  • After the new .SORT and .RFI have been generated, we will generate new .crad_pol_lst files with:

    do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO

  • work on a shell to find out if we have data in the "raw" directories
    • ./checkDataSize.sh 2012347 2012365
    • ./checkDataSize.sh 2013001 2013365
    • ./checkDataSize.sh 2014001 2014365
all logged in ~/data1/PAO/RAWfileSize.log

27 OCT 2015:

  • write script to plot raw data size vs time to assess if there is data at a certain time period (/home/bandma01/Dropbox/UQAR/MEOPAR_Marion/Matlab_Analysis/dataConversion/DataPresence_log2mat.m)

  • run same script on wera server for PAB (same dates)

  • modifier Header.txt dans RadialConfigs des CODARs (PAP1) pour mettre CurrMax a 100.
    • /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_PAP1_20130201_BAPM_MUSIC402002_nosmooth
  • reprocesser CODAR PAP1 pour 10 mai 2013 with:
    • cd hfr-data-processing/postprocessing/codar/
    • ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 10

28 OCT 2015:

1- reprocess CODAR PAP1 for May 11, 2013

  • ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s PAP1 -a 2013 -m 05 -j 11

  • modifier Header.txt dans RadialConfigs des CODARs (STF2) pour mettre CurrMax a 100.
    • /Volumes/CodarData/Codar/SeaSonde/Configs/RadialConfigs_STF2_20130206_BAPM_MUSIC402002_nosmooth
  • reprocesser CODAR STF2 pour 10 mai 2013
    • ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 10
    • ./lancerTraitementSpectraCodar.sh -n ModifCurrMax -s STF2 -a 2013 -m 05 -j 11
2- reprocesser WERA PAB pour september 2013 avec nouvelles phases
=> no data at this time

3- WERA PAO: convert lst files to .mat for new calibrations using radiallst2uv.m - use RadialVeloCompa_Sept2013_HFR_ADCP_WERA_ADCPcorrected_v2.m to generate new .mat data and use PlotRadialVeloCompa_Sept2013_HFR_ADCP_WERA_v2.m to generate new plots.

29 OCT 2015:

  • work on figures of WERA PAO generated with new phases.
  • realise there is a problem with new calibration output files: they are the same as with the old calibrations...
  • investigate on wera server if possible mistake in shell scripts
  • transfer with ssh of old calibrations results
  • work on MEOPAR HQP section for NCE renewal application

2 NOV 2015:

  • work on pb with new phases PAO: check shell scripts on WERA serveur
  • try with 1 day (2013244): seems ok
  • process by hand each day: ./do_postprocess_SORT_newCalib.sh -s PAO -y 2013273

3 NOV 2015:

  • finish analysis by hand: take .SORT and output .crad_pol_lst

    => do_process_SORT_pol 2013244 2013273 /home/wera/data1/PAO

5 NOV 2015:

  • ftp transfer of .crad_pol_lst to local hard Drive

    => ./do_filetransferssh.sh 2013245 2013273

rsync -v -e ssh wera@132.215.11.14:~/data1/PAO/${JOUR}/results/new/*.crad_pol_lst /run/media/bandma01/SeagateWireless/MEOPAR/DATA/HFRs/WERAs/PAO/optimisationPAO/version5_PAO_old_nofullcal/checkNewCalib/ - use radiallst2uv.m

the new phases are so close to the old ones that there isn't any real differences in the radial currents

16 Nov 2015:

  • work on HFR WERA direction

17 Nov 2015:

  • generate PlotRadialVeloCompa_Sept2013_HFR_ADCP_WERA_v2.m for old and new calibrations (PAO)