Verify the analysis code for hybrid labeling

e-mission / e-mission-eval-private-data

Evaluate the e-mission platform along various metrics

BSD 3-Clause "New" or "Revised" License

1 stars 11 forks source link

Verify the analysis code for hybrid labeling #30

Open shankari opened 2 years ago

shankari commented 2 years ago

@shankari will send a mongodump of data from < 10 users at NREL
@allenmichael099 will delete all existing data from the mongodb and load the new mongodump
then run the functions individually for the user and verify that they are correct

import emission.storage.decorations.user_queries as esdu

users = esdu.get_all_uuids()
ct_df = do_matching(users)
if ct_df["label_write_time"] != [expected_values]:
     print("ERROR: ")

shankari commented 2 years ago

If you want to browse the raw data in the database before it is read into the notebook, you can try to use this GUI tool https://www.mongodb.com/try/download/compass

shankari commented 2 years ago

@allenmichael099 I have extracted data from 9 NREL users and shared the mongodump (analysis_validation_set.tar.gz) with you. LMK if you have any issues loading it.