search

heliohackweek / mms_data_hunt

https://heliohackweek.github.io/mms_data_hunt/
1 stars 4 forks source link

Data parsing changes #5

Closed jackpayette closed 4 years ago

jackpayette commented 4 years ago

I've added some code to example_sitl_read.ipynb which helps with parsing and creating calculated fields for easy queries on the SITL data. This is a bit crude, but I hope can help us extract ~ 200's of records and potential date time ranges of BBFs which we can link up and relate to the measurement data and process in ML.

jackpayette commented 4 years ago

So one thing is how to handle "multiple events", not sure how that will impact things, but we'll see. I will try to flag these in our data tomorrow.

SITL_identified_BBFs

How many records we have to work with will also be important. How we decide to split up the dataset and filter it, etc. hopefully for ML.

SITL_ML_data

These are rough filters and ideas, but hopefully will help. Thanks, Jack