search

aodn / imos-toolbox

Graphical tool for QC'ing and NetCDF'ing oceanographic datasets
GNU General Public License v3.0
46 stars 31 forks source link

Nortek_VECTOR ADV #650

Open Krys1202 opened 4 years ago

Krys1202 commented 4 years ago

Hi, I would like to know if the format .vec from the Nortek Vector could be integrated in the IMOS toolbox? Vector_web_LR.pdf I have a raw data file " .vec" but too big to attach here (58MB).

Cheers, Christelle

ocehugo commented 4 years ago

Hi @Krys1202 ,

quick questions:

  1. Is the Nortek Vector part of a new imos instrument sampling!?
  2. You may share the file in the way that works best for you (dropbox,google-drive,firefox-send,etc).
  3. If applicable, may you also share a generated ASCII file from the raw data!?
sspagnol commented 4 years ago

For what its worth have attached a not extensively tested bit of code (was for a not IMOS related project), but it might be enough for your needs.

Please note:

vectorParse.zip

ocehugo commented 4 years ago

we need to update the Paradopp help then - It says we "should" be able to read Vector files.

Problem here is that I don't have access to a file so can't do much atm

petejan commented 4 years ago

I have used these before, and processed them with python.

@Krys1202 There are many options with this instrument, are you operating in burst mode? Does your vector have the AHRS installed?

Krys1202 commented 4 years ago

Hi @Krys1202 ,

quick questions:

  1. Is the Nortek Vector part of a new imos instrument sampling!?
  2. You may share the file in the way that works best for you (dropbox,google-drive,firefox-send,etc).
  3. If applicable, may you also share a generated ASCII file from the raw data!?

1-No I don't think so. We used this instrument for the AUSTEn Project (AMC/UTAS project) with Camille Couzi. If it must be an instrument used by IMOS, no worries! I just wanted to know what was possible to do :-) 2- Link to download raw data ".vec": https://we.tl/t-uzW3gErJNM
3- I manage to extract .txt, but looks weird ( velocity=0) ADV.txt

Krys1202 commented 4 years ago

For what its worth have attached a not extensively tested bit of code (was for a not IMOS related project), but it might be enough for your needs.

Please note:

  • Requires slightly modified readParadoppBinary, so do all your testing in a seperate branch just in case
  • I only had one instrument file example, the instrument was mounted onto a bottom frame looking down, the user has since retired and never got back to me if the resultant file looked correct. Would have to compare against the ascii exported stuff.
  • Only handles ENU data.
  • It doesn't handle IMU sectors.

vectorParse.zip

Thanks for this! I will have a look, the configuration for this ADV is quite the same : mounted on a bottom frame with an Aquadopp, looking down .

Krys1202 commented 4 years ago

I have used these before, and processed them with python.

@Krys1202 There are many options with this instrument, are you operating in burst mode? Does your vector have the AHRS installed?

@petejan : Burst mode, and yes for AHRS

petejan commented 4 years ago

If you're willing to work with python and don't really need IMOS complaint netCDF files, then you could use,

nortek2netCDF.py

Its quite specific to what I was doing and my configuration but you might be able to make it work.

ocehugo commented 4 years ago

1-No I don't think so. We used this instrument for the AUSTEn Project (AMC/UTAS project) with Camille Couzi. If it must be an instrument used by IMOS, no worries! I just wanted to know what was possible to do :-)

It doesn't need to be an IMOS instrument - It's just that - if it's an IMOS instrument - I need to put this in top priority.

2- Link to download raw data ".vec": https://we.tl/t-uzW3gErJNM 3- I manage to extract .txt, but looks weird ( velocity=0) ADV.txt

Thanks - I will need this eventually to test and evaluate the changes required.

sspagnol commented 4 years ago

And from data conversion using vector software your pitch/roll values in sen file are large and lots of error messages in ssl file with "Roll out of range" and "Pitch out of range".

Krys1202 commented 4 years ago

If you're willing to work with python and don't really need IMOS complaint netCDF files, then you could use,

nortek2netCDF.py

Its quite specific to what I was doing and my configuration but you might be able to make it work.

Thanks for this I will have a try with python

Krys1202 commented 4 years ago

And from data conversion using vector software your pitch/roll values in sen file are large and lots of error messages in ssl file with "Roll out of range" and "Pitch out of range".

Yeah it doesn't seem like very good data, there was a storm during the 3-day deployment ....

petejan commented 4 years ago

@Krys1202 Your data file looks quite different from what I was processing, I don't see any IMU data records, so my python needs some tweaks to get it working, as I don't use the instrument pitch/roll but the data from the IMU, and did not write the system data to the output netCDF file as I did not need it for what I was looking at.