search

ODM2 / ODM2DataSharingPortal

A Python-Django web application enabling users to upload, share, and display data from their environmental monitoring sites via the app's ODM2 database. Data can either be automatically streamed from Internet of Things (IoT) devices, manually uploaded via CSV files, or manually entered into forms.
BSD 3-Clause "New" or "Revised" License
31 stars 8 forks source link

Add dimensionless integer variable for housekeeping #315

Closed aufdenkampe closed 5 years ago

aufdenkampe commented 6 years ago

After the next release, which will fix #292, we will want to implement the following suggestion from @neilh10 via his email. Addressing #261 will make it possible to implement the second half of this suggestion.

I'd like to suggest a dimensionless number/integer - possibly under Sensor Manufacturer=ALL, Sensor Model =Calculated Measured Variable= Dimensionless

Workaround: For data.envirodiy.org I can use any sensor to create a display and mark it in the comments as to its true purpose.

The reason is for housekeeping - its standard in the transfer of data to have a sequence number. This allows a very easy method to determine if all the data has transferred correctly.

An idea could be the ability to mark the sensor as housekeeping - so it only appears to the owner, similar to the UUID keys.

Reason: When visualizing data on graphs from a distributed database- its difficult to detect data transfer losses. Its much easier to visually detect a number or group of numbers have been skipped than analyzing all the time records. Its also easier to see if there was a "reset" or new series if the the sequence number starts again..

For the latest Mayfly testing I'm planning on creating a processor_stats.sensor that sends a sequence number with each message. This will start at 0 on hard reset or logging file creation, and
transfer with each message.

many thanks for all the work going into data.envirodiy.org - its great to see the web presentation and shows up very quick. My main purpose is to work the Mayfly example and to use simple local data to visualize that first. I suspect there is some fine tuning going on, as I'm trying to figure out some of the visualization mappings.

SRGDamia1 commented 6 years ago

Can't you just do that quickly on the admin panel?

SRGDamia1 commented 5 years ago

I think this has been done.

aufdenkampe commented 5 years ago

Yes! Thanks @SRGDamia1 for the housekeeping on this!

neilh10 commented 5 years ago

Just wondering - is this available on https://data.envirodiy.org - I don't see anything if I go through "Add New Sensor" - I tried Sensor Manufacturer=ALL, Sensor Model =Calculated Measured Variable=

I'm actually looking to create sensors that show current taken by a large piece of equipment - a fisheries PIT Tag array. The current can go to 8A. I'm using Sensor INA219, with Current Measurements A

SRGDamia1 commented 5 years ago

Right now I think it's assigned to a Mayfly