frictionlessdata / pilot-dm4t

Pilot project with DM4T
http://www.cs.bath.ac.uk/dm4t/index.shtml
1 stars 1 forks source link

How to model ApatSCHE dataset? #17

Closed danfowler closed 6 years ago

danfowler commented 7 years ago

@cblop do you have a sense of which files can be skipped, which contain useful info, and how these tables relate to each other?

legend:Files dan$ head -n 2 *
==> appliance 1_MW.csv <==
Id,time_created,GMT,power1
10353,1379756117,21/09/2013 09:35:17,0

==> appliance 1_MW_0327.csv <==
"Id","time_created","power1"
"8960","1378993253","150"

==> appliance 2_F.csv <==
Id,time_created,GMT,power2
86,1379756119,21/09/2013 09:35:19,5

==> appliance 2_F_0327.csv <==
"Id","time_created","power2"
"86","1379756119","5"

==> appliance 3_k.csv <==
Id,time_created,GMT,power3
75,1379756118,21/09/2013 09:35:18,0

==> appliance 3_k_0327.csv <==
"Id","time_created","power3"
"75","1379756118","0"

==> environment.csv <==
Id,time_created,GMT,mid,temp,hum
13660,1379755932,21/09/2013 09:32:12,1D01,18.1,57

==> environment_0327.csv <==
Id,time_created,,mid,temp,hum
7027,1379000520,12/09/2013 15:42:00,EB01,24.6,58

==> meter.csv <==
Id,time_created,GMT,power0
21662,1379756120,21/09/2013 09:35:20,109

==> meter_20131021.csv <==
413203,1382313600,21/10/2013 00:00,121
413204,1382313607,21/10/2013 00:00,120

==> meter_20140327.csv <==
"Id","time_created","power0"
"21662","1379756120","109"

==> motion_0327.csv <==
Id,time_created,,mid,motion
50,1379006299,,A1,1

==> motion_non.csv <==
Id,time_created,GMT,mid,motion
50,1379006299,12/09/2013 17:18,A1,1
pwalsh commented 7 years ago

@danfowler can this now be closed?

danfowler commented 7 years ago

@cblop if we are to include in the final pilot, I need some advice here. Have you worked with this dataset yet?

cblop commented 7 years ago

I've sent an email to the APAtSCHE project lead asking for documentation. I'll let you know what his response is. Otherwise, it might be worth considering dropping this dataset from the pilot: we don't have any documentation (yet), and the CSV files that we do have are only a sample, collected from just 1 of the 25 houses. Strathclyde seem reluctant to give us any more data just yet.

danfowler commented 7 years ago

Thanks @cblop. This is helpful!

pwalsh commented 6 years ago

We will skip the APAtSCHE data for this pilot. Closing.