jpshanno / ingestr

ingestr: An R package for reading environmental data from raw formats into dataframes.
https://jpshanno.github.io/ingestr/
MIT License
18 stars 3 forks source link

Add support for various devices and loggers #17

Open the-Hull opened 6 years ago

the-Hull commented 6 years ago

Dear Joe / ingestr dev's,

here's a copy of the README.md I added to the data (example_data_files.zip).

Data example files for ingestr


Source / contact: A. Hurley, @aglHurley (twitter)


Overview / Meta

Data files provided:

  1. DELTA-T_HH2-LOGGER_ML2-PROBE-VWC.CSV
  2. DELTA-T_HH2-LOGGER_PR2-PROBE-VWC.CSV
  3. HOBO_U23-001_TEMP-RH.hobo
  4. TINY-TAG_TK-4023_TEMP.ttd

Info

Files are from direct device download or export from manufacturer software. Names are formatted in the following pattern, seperated by underscores:

Please not that I did not produce the HH2 files personally, and cannot comment on specific settings (e.g. Soil Type or Sensor Depth), other potential values or cell positions ([row,column]).


Disclaimer

I do not claim any ownership of copyrighted brand/manufacturer or device names, as well as their file type or data storing systems; I further do not claim any ownership of outputs (e.g. software) produced by a third party

reblake commented 5 years ago

.hobo still appears to be proprietary, with no way to access directly in R. The company advises using their software to read the .hobo file and then export a .csv file. See conversation here: https://www.onsetcomp.com/support/forum/post/hoboware-reading-hobo-files-r

jpshanno commented 5 years ago

Here is the code for a not-quite-finished ingestr function for a plate reader we use. It has subtables nested inside of a CSV, but they are a fixed size which makes it a little easier. The basic approach is to use scan() to read in the raw text, and then use keywords to identify key points and then either index forwards or backwards to get the stop/start point of that table. Maybe for the variable-sized tables inside these files it'd be possible to identify the start points of each table, and then index backwards to find the end points of the previous tables? Code: ingest_spectramax2.txt

Data: spectramax2.txt