search

GRIDAPPSD / GOSS-GridAPPS-D

14 stars 27 forks source link

Latest time-series data still has missing values for 15 min interval #1390

Open shpoudel opened 3 years ago

shpoudel commented 3 years ago

The recent time-series database is almost suitable to use as AMI data. Two things that I noticed:

  1. Few NaNs were still there.
  2. I also noticed a few measurement mrids missing in the query. For example, in the following image, one sensor data (_550d9b41-6252-40f8-b320-0c82d40cb7ef) is missing for timestep 15:00:02.

Note that the query was done with only 3 measurement mrids in the filter with the following starttime and endtime.

starttime = datetime(2013, 7, 11, 14, 45, 2) endtime= datetime(2013, 7, 11, 15, 30, 2)

measurement_mrid = ['_3fe87015-7e58-4271-ae78-523dc47b47ad', '_e5e29165-0c89-4ca4-8f48-2b79edc365ee', '_550d9b41-6252-40f8-b320-0c82d40cb7ef']

image

shpoudel commented 3 years ago

@craig8 : Did you get a chance to look at this?

ericstephan commented 3 years ago

Is it possible that records are being overwritten?

From: shpoudel notifications@github.com Reply-To: GRIDAPPSD/GOSS-GridAPPS-D reply@reply.github.com Date: Tuesday, November 24, 2020 at 11:46 To: GRIDAPPSD/GOSS-GridAPPS-D GOSS-GridAPPS-D@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: Re: [GRIDAPPSD/GOSS-GridAPPS-D] Latest time-series data still has missing values for 15 min interval (#1390)

Check twice before you click! This email originated from outside PNNL.

@craig8https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fcraig8&data=04%7C01%7CEric.Stephan%40pnnl.gov%7C7130eba781364f5d6d6308d890b1b0da%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637418440146035463%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=m%2B3J1MM%2FTcnYDqnmRVrp2x4dpklUo0U0HAy3J0qwmZY%3D&reserved=0 : Did you get a chance to look at this?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FGRIDAPPSD%2FGOSS-GridAPPS-D%2Fissues%2F1390%23issuecomment-733194633&data=04%7C01%7CEric.Stephan%40pnnl.gov%7C7130eba781364f5d6d6308d890b1b0da%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637418440146045420%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=RrbnNBjOgnXYxVdQWZFSp6HqxuBmFrlZCkpN9AkbnlA%3D&reserved=0, or unsubscribehttps://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAA2ZILNXGBYTWDO6OPQ4BQ3SRQEPVANCNFSM4TX4VGDA&data=04%7C01%7CEric.Stephan%40pnnl.gov%7C7130eba781364f5d6d6308d890b1b0da%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637418440146045420%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=xLuc9O5wnISlVs%2BuZ68U%2FgS%2FWpEqMuFVbQJucALqhqM%3D&reserved=0.