UtilitechAS / amsreader-firmware

ESP8266 and ESP32 compatible firmware to read, interpret and publish data to MQTT from smart electrical meters, both DLMS and DSMR is supported
Other
381 stars 73 forks source link

Loosing stored data #596

Closed leakim1957 closed 1 year ago

leakim1957 commented 1 year ago

I have v2.2.20 and last night at 01.00 all stored data both "Energy use last 24 hours" as well as "Energy use last 31 days" was lost, see picture. This is not the first time this happends. I remember at least two other occations after the HW was replaced in january. Skärmbild 2023-06-16 090411

gskjold commented 1 year ago

Sounds like there could be some sort of edge case where this happens. Would have to look into that. Does your device have access to internet?

leakim1957 commented 1 year ago

Hi Gunnar Yes, internet access 24/7. If there should be an internet drop out at some time, why would that erase the memory stored?

///Mikael

Från: Gunnar Skjold @.> Skickat: den 16 juni 2023 09:08 Till: UtilitechAS/amsreader-firmware @.> Kopia: leakim1957 @.>; Author @.> Ämne: Re: [UtilitechAS/amsreader-firmware] Loosing stored data (Issue #596)

Sounds like there could be some sort of edge case where this happens. Would have to look into that. Does your device have access to internet?

- Reply to this email directly, view it on GitHubhttps://github.com/UtilitechAS/amsreader-firmware/issues/596#issuecomment-1594212364, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BATT35ICL3VSI2ASO3K2LUTXLQA5ZANCNFSM6AAAAAAZI2YH4M. You are receiving this because you authored the thread.Message ID: @.**@.>>

gskjold commented 1 year ago

It shouldn't, but if it does not have internet access, it gets time from the meter which in some cases are not completely reliable, and if the time drift is too high, the data is cleared

leakim1957 commented 1 year ago

Ok, I will check the connection. Can you specify the time drift, Is it seconds, minutes or hours?

gskjold commented 1 year ago

If the timestamp was suddenly in the past compared to last stored point in time, or if the time is more than 1day or 1month in the future respectively. But I think this is probably some other edge case that have caused this. As long as the device boots with a set timestamp, the time should not be an issue.

gskjold commented 1 year ago

I've tried to find some way to reproduce this, but I have yet to succeed. Could you give me some more information:

Country: Manufacturer and model of meter: AMS reader hardware:

leakim1957 commented 1 year ago

Hi Gunnar See my answers below in red. I would like to add that I have only had data saved for a maximum of 5 days in a row for the past few months. Sometimes only 1 day, sometimes 2-3 days. ///Mikael BW

Från: Gunnar Skjold @.> Skickat: den 18 augusti 2023 09:57 Till: UtilitechAS/amsreader-firmware @.> Kopia: leakim1957 @.>; Author @.> Ämne: Re: [UtilitechAS/amsreader-firmware] Loosing stored data (Issue #596)

I've tried to find some way to reproduce this, but I have yet to succeed. Could you give me some more information:

Country: Sweden

Manufacturer and model of meter: Sagemcom T211

@.***

AMS reader hardware:

@.***

- Reply to this email directly, view it on GitHubhttps://github.com/UtilitechAS/amsreader-firmware/issues/596#issuecomment-1683518324, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BATT35OAOOF3CEKEJM4C3PDXV4N53ANCNFSM6AAAAAAZI2YH4M. You are receiving this because you authored the thread.Message ID: @.**@.>>

ArnieO commented 1 year ago

@leakim1957 That did not work well (we cannot see what is "red"). You need to log into Github and write your message there.

leakim1957 commented 1 year ago

Hope this will be better:-)

Country: Sweden

Manufacturer and model of meter: Sagemcom T211, see picture Skärmbild 2023-08-18 124910

AMS reader hardware: See picture Skärmbild 2023-08-18 124718

ArnieO commented 1 year ago

@leakim1957 You closed the issue - was that on purpose, or was it a mistake?

OK - you are running a Pow-P1 on a Sagemcom in Sweden. We have several such installations running, I don't think the hardware is an issue.

Sounds more like some strange edge issue, probably related to other reports lately of missing/lost data. @gskjold is working on it, trying to recreate the issue.

gskjold commented 1 year ago

Got two issues regarding loosing data, both Sagemcom, do you know of any more cases @ArnieO ?

ArnieO commented 1 year ago

Got two issues regarding loosing data, both Sagemcom, do you know of any more cases @ArnieO ?

None other than those reported in issues here on Github.

leakim1957 commented 1 year ago

It was a mistake, I am not used to work in github

stigvi commented 1 year ago

Some kind of issues with mine too. Uptime is 34 days, but only the last 19 have any data.

image

gskjold commented 1 year ago

Interesting indeed, something definitely happened here

stigvi commented 1 year ago

Interesting indeed, something definitely happened here

Hi. I see from my Tibber App that 8th of August was rather special because my energy cost that day was NOK -1.90. I don't have any entsoe prices downloaded to my unit, so I am not able to see any connection to the missing data. But maybe there is?

gskjold commented 1 year ago

Good to think outside the box here, thanks for that. I am not able to see a connection there either, but will keep it in mind

gskjold commented 1 year ago

I finally understand what is going on here now, will fix this for next patch

leakim1957 commented 1 year ago

Can´t wait to test it :-)

senspix commented 1 year ago

Possibly the same issue but with month plot. Also Sagemcom T211 device in Sweden. Screenshot 2023-09-18 at 15 45 26

leakim1957 commented 1 year ago

Hi. Loading screen shot of system after installing latest version. Let´s see what happends with stored data as time goes by. ///Mikael

Skärmbild 2023-09-29 142358

leakim1957 commented 11 months ago

Hi, just when I hoped the problem was solved, it has appeared again. No problems since last update but tonight at 0200 it went blank and no update of prices either. ///Mikael Skärmbild 2023-10-12 093917

leakim1957 commented 10 months ago

AMS reader 31 day ok

31 days in a row without loosing data. Well done!!! ///Mikael

ArnieO commented 10 months ago

So - let us hope this bug is dead and gone for ever now!