scottgullaksen / bergenvann-summer-project

Analysis of Bergen Vanns sensor data for maintanance evaluation purposes
0 stars 0 forks source link

[Task] Export preprocessed data as pandas dataframes #10

Closed scottgullaksen closed 4 years ago

scottgullaksen commented 4 years ago

Description

After having a mechanism of reading from preprocessed dataset we woul like to have a mechansim for exporting this data as pandas dataframes. More compatible with plotting functions.

Consideratons

scottgullaksen commented 4 years ago

Let's start off by making a simple script in plotter.py that converts retrieved contents from files into pandas dataframes. Functionality can be moved later on if required/more beneficial.

ML algoritmes usually accept numy arrays, so it might make sense to seperate that functionalitty from the pickled reader class

scottgullaksen commented 4 years ago

solution: to_dataframe method. In short: Returns a dict of dataframes corresponding to each station where the dataframe holds the measurments for that station

scottgullaksen commented 4 years ago

Update: There's now included an optional argument (df) in reader.py's get_data method for retrieving the dataset as a pandas dataframe.