No messages sent to mqtt broker ?

karlkashofer commented 1 year ago

Hi ! I seem to not get messages with meter readings to my mqtt broker, only the status messages are transmitted. Here is the log using just the provided test data:

pi@strompi:~/services/dsmr/test/dsmr2mqtt $ python3 dsmr-mqtt.py 
dsmr-mqtt INFO: FUNCTION:<module> LINE:82: Starting dsmr-mqtt.py; version = 2.0.0
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:__init__ LINE:103: >> paho-mqtt version = 1.6.1
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:__init__ LINE:117: MQTT Client ID = mqtt-dsmr
dsmr-mqtt.P1_serial DEBUG: FUNCTION:__init__ LINE:51: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__init__ LINE:50: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__init__ LINE:66: NROF = 1
dsmr-mqtt.hadiscovery DEBUG: FUNCTION:__init__ LINE:49: >>
dsmr-mqtt DEBUG: FUNCTION:<module> LINE:186: __main__: >>
dsmr-mqtt DEBUG: FUNCTION:main LINE:150: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:will_set LINE:425: >>
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:517: Broker = 192.168.1.5>>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__internet_on LINE:222: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:run LINE:215: >>
dsmr-mqtt.hadiscovery DEBUG: FUNCTION:run LINE:128: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__internet_on LINE:229: Internet connectivity to MQTT broker 192.168.1.5 at port 1883 available
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:575: Start mqtt loop...
dsmr-mqtt.P1_serial DEBUG: FUNCTION:run LINE:198: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:408: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_status LINE:391: >>
dsmr-mqtt.P1_serial DEBUG: FUNCTION:__read_serial LINE:152: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=online
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/dsmr-device/config; MESSAGE={"name":"dsmr reader","unique_id":"dsmr-device","state_topic":"test_dsmr/status","icon":"mdi:home-automation","device":{"name":"dsmr reader","sw_version":"2.0.0","model":"P1 USB/dsmr-mqtt","manufacturer":"hansij66 @github.com","identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:587: Disconnect TIMER = 0
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/sw-version; MESSAGE=main=2.0.0; mqtt=2.0.0
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/p_consumed/config; MESSAGE={"unique_id":"p_consumed","state_topic":"test_dsmr/el","name":"Total power usage [W]","unit_of_measurement":"W","value_template":"{{value_json.p_consumed}}","device_class":"power","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/p_generated/config; MESSAGE={"unique_id":"p_generated","state_topic":"test_dsmr/el","name":"Total power generation [W]","unit_of_measurement":"W","value_template":"{{value_json.p_generated}}","device_class":"power","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:587: Disconnect TIMER = 0
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/gas_consumed/config; MESSAGE={"unique_id":"gas_consumed","state_topic":"test_dsmr/gas","name":"gas consumption [m\u00b3]","unit_of_measurement":"m\u00b3","value_template":"{{value_json.gas_consumed|float/1000|round(0)}}","device_class":"gas","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__on_connect LINE:262: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__on_connect LINE:264: Connected: userdata=None; flags={'session present': 0}; rc=Success: Connection Accepted.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/el_consumed/config; MESSAGE={"unique_id":"el_consumed","state_topic":"test_dsmr/el","name":"EL consumed [Wh]","unit_of_measurement":"Wh","value_template":"{{value_json.el_consumed}}","device_class":"energy","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_connected_flag LINE:237: >> flag=True; current __connected_flag=False
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_status LINE:391: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/el_returned/config; MESSAGE={"unique_id":"el_returned","state_topic":"test_dsmr/el","name":"EL returned [Wh]","unit_of_measurement":"Wh","value_template":"{{value_json.el_returned}}","device_class":"energy","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=online
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V1/config; MESSAGE={"unique_id":"V1","state_topic":"test_dsmr/el","name":"Voltage L1 [V]","unit_of_measurement":"V","value_template":"{{value_json.V1}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V2/config; MESSAGE={"unique_id":"V2","state_topic":"test_dsmr/el","name":"Voltage L2 [V]","unit_of_measurement":"V","value_template":"{{value_json.V2}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V3/config; MESSAGE={"unique_id":"V3","state_topic":"test_dsmr/el","name":"Voltage L3 [V]","unit_of_measurement":"V","value_template":"{{value_json.V3}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}}
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_serial DEBUG: FUNCTION:__read_serial LINE:180: EOF Detected in test/dsmr.raw
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:run LINE:232: <<
dsmr-mqtt.P1_serial DEBUG: FUNCTION:__read_serial LINE:194: <<
dsmr-mqtt.P1_serial DEBUG: FUNCTION:run LINE:211: <<
dsmr-mqtt DEBUG: FUNCTION:main LINE:167: t_serial.join exited; set stopper for other threats
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:408: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_status LINE:391: >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=offline
dsmr-mqtt DEBUG: FUNCTION:main LINE:178: <<
dsmr-mqtt DEBUG: FUNCTION:<module> LINE:193: __main__: <<
dsmr-mqtt INFO: FUNCTION:close LINE:96: Exitcode = 1 >>
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:600: Close down MQTT client & connection to broker
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:__on_disconnect LINE:294: Expected disconnect, userdata = None; rc = 0: No error.
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_connected_flag LINE:237: >> flag=False; current __connected_flag=True
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__set_connected_flag LINE:242: Disconnect TIMER started
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:606: Shutting down MQTT Client... 13 MQTT messages have been published
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:608: <<
dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:__del__ LINE:211: >>
dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:__del__ LINE:212: Shutting down MQTT Client... 13 MQTT messages have been published
dsmr-mqtt.P1_serial DEBUG: FUNCTION:__del__ LINE:84: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__del__ LINE:69: >>
dsmr-mqtt.hadiscovery DEBUG: FUNCTION:__del__ LINE:59: >>
pi@strompi:~/services/dsmr/test/dsmr2mqtt $

Any idea what i am doing wrong ?

hansij66 commented 1 year ago

Hi,

Thanks for having interest in my project!

A few suggestions....it is normal that MQTT is initailly not connecting
On Windows, use MQTT Explorer....I think you will see some initial MQTT messages.....
As I have a real P1 USB probe, I don;t use the test data anymore....I could be that it doesn't work (I haven;t tested this anymore)
==> I will test the test data ....but a bit too busy with other projects
dsmr does work for me with a real USB P1 probe..it is up & running as you speak.

On Sat, Jun 3, 2023 at 8:47 PM karlkashofer @.***> wrote:

Hi ! I seem to not get any messages to my mqtt broker, here is the log using just the provided test data:

@.*:~/services/dsmr/test/dsmr2mqtt $ python3 dsmr-mqtt.py dsmr-mqtt INFO: FUNCTION: LINE:82: Starting dsmr-mqtt.py; version = 2.0.0 dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:init LINE:103: >> paho-mqtt version = 1.6.1 dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:init LINE:117: MQTT Client ID = mqtt-dsmr dsmr-mqtt.P1_serial DEBUG: FUNCTION:init LINE:51: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:init LINE:50: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:init LINE:66: NROF = 1 dsmr-mqtt.hadiscovery DEBUG: FUNCTION:init LINE:49: >> dsmr-mqtt DEBUG: FUNCTION: LINE:186: main: >> dsmr-mqtt DEBUG: FUNCTION:main LINE:150: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:will_set LINE:425: >> dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:517: Broker = 192.168.1.5>> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:internet_on LINE:222: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:run LINE:215: >> dsmr-mqtt.hadiscovery DEBUG: FUNCTION:run LINE:128: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:internet_on LINE:229: Internet connectivity to MQTT broker 192.168.1.5 at port 1883 available dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:575: Start mqtt loop... dsmr-mqtt.P1_serial DEBUG: FUNCTION:run LINE:198: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:408: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:391: >> dsmr-mqtt.P1_serial DEBUG: FUNCTION:read_serial LINE:152: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=online dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/dsmr-device/config; MESSAGE={"name":"dsmr reader","unique_id":"dsmr-device","state_topic":"test_dsmr/status","icon":"mdi:home-automation","device":{"name":"dsmr reader","sw_version":"2.0.0","model":"P1 USB/dsmr-mqtt","manufacturer":"hansij66 @github.com","identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:587: Disconnect TIMER = 0 dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/sw-version; MESSAGE=main=2.0.0; mqtt=2.0.0 dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/p_consumed/config; MESSAGE={"unique_id":"p_consumed","state_topic":"test_dsmr/el","name":"Total power usage [W]","unit_of_measurement":"W","value_template":"{{value_json.p_consumed}}","device_class":"power","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/p_generated/config; MESSAGE={"unique_id":"p_generated","state_topic":"test_dsmr/el","name":"Total power generation [W]","unit_of_measurement":"W","value_template":"{{value_json.p_generated}}","device_class":"power","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:587: Disconnect TIMER = 0 dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/gas_consumed/config; MESSAGE={"unique_id":"gas_consumed","state_topic":"test_dsmr/gas","name":"gas consumption [m\u00b3]","unit_of_measurement":"m\u00b3","value_template":"{{value_json.gas_consumed|float/1000|round(0)}}","device_class":"gas","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt WARNING: FUNCTION:do_publish LINE:451: MQTT publish was not successfull, rc = 4: The client is not currently connected. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:on_connect LINE:262: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:on_connect LINE:264: Connected: userdata=None; flags={'session present': 0}; rc=Success: Connection Accepted. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/el_consumed/config; MESSAGE={"unique_id":"el_consumed","state_topic":"test_dsmr/el","name":"EL consumed [Wh]","unit_of_measurement":"Wh","value_template":"{{value_json.el_consumed}}","device_class":"energy","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_connected_flag LINE:237: >> flag=True; current connected_flag=False dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:391: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/el_returned/config; MESSAGE={"unique_id":"el_returned","state_topic":"test_dsmr/el","name":"EL returned [Wh]","unit_of_measurement":"Wh","value_template":"{{value_json.el_returned}}","device_class":"energy","state_class":"total","icon":"mdi:counter","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=online dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V1/config; MESSAGE={"unique_id":"V1","state_topic":"test_dsmr/el","name":"Voltage L1 [V]","unit_of_measurement":"V","value_template":"{{value_json.V1}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V2/config; MESSAGE={"unique_id":"V2","state_topic":"test_dsmr/el","name":"Voltage L2 [V]","unit_of_measurement":"V","value_template":"{{value_json.V2}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}} dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=homeassistant/sensor/test_dsmr/V3/config; MESSAGE={"unique_id":"V3","state_topic":"test_dsmr/el","name":"Voltage L3 [V]","unit_of_measurement":"V","value_template":"{{value_json.V3}}","device_class":"voltage","icon":"mdi:gauge","device":{"identifiers":["dsmr"]}} dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_serial DEBUG: FUNCTION:read_serial LINE:180: EOF Detected in test/dsmr.raw dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:run LINE:232: << dsmr-mqtt.P1_serial DEBUG: FUNCTION:read_serial LINE:194: << dsmr-mqtt.P1_serial DEBUG: FUNCTION:run LINE:211: << dsmr-mqtt DEBUG: FUNCTION:main LINE:167: t_serial.join exited; set stopper for other threats dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:408: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_status LINE:391: >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=test_dsmr/status; MESSAGE=offline dsmr-mqtt DEBUG: FUNCTION:main LINE:178: << dsmr-mqtt DEBUG: FUNCTION: LINE:193: main: << dsmr-mqtt INFO: FUNCTION:close LINE:96: Exitcode = 1 >> dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:run LINE:600: Close down MQTT client & connection to broker dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:on_disconnect LINE:294: Expected disconnect, userdata = None; rc = 0: No error. dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_connected_flag LINE:237: >> flag=False; current connected_flag=True dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:set_connected_flag LINE:242: Disconnect TIMER started dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:606: Shutting down MQTT Client... 13 MQTT messages have been published dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:run LINE:608: << dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:del LINE:211: >> dsmr-mqtt.mqtt.mqtt INFO: FUNCTION:del LINE:212: Shutting down MQTT Client... 13 MQTT messages have been published dsmr-mqtt.P1_serial DEBUG: FUNCTION:del LINE:84: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:del LINE:69: >> dsmr-mqtt.hadiscovery DEBUG: FUNCTION:del__ LINE:59: >> *@.:~/services/dsmr/test/dsmr2mqtt $

Any idea what i am doing wrong ?

— Reply to this email directly, view it on GitHub https://github.com/hansij66/dsmr2mqtt/issues/4, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFFPZDZK6LJWD6M4NHGHQQDXJOBCXANCNFSM6AAAAAAYZOGOWE . You are receiving this because you are subscribed to this thread.Message ID: @.***>

karlkashofer commented 1 year ago

I dont see any messages with meter content in MQTT Explorer, only the status messages present in the log. When i run dsmr2mqtt the test-dsmr/status topic goes to "online" correctly, and to "offline" when the script exits. The broker is processing messages from various sensors around my house, all looking normal.

dsmr2mqtt also does not work with my real P1 probe, attached to Sagemcom and decoded by dsmr-proxy.

I presume there should be mqtt message log entries between all the

dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>
dsmr-mqtt.P1_parser DEBUG: FUNCTION:__decode_telegrams LINE:188: >>

lines ?

What i did: git clone the repo on a raspberry pi zero with python3 and fresh paho-mqtt 1.6.1 set ip of mqtt broker, set production to false and loglevel to DEBUG. I have no username or password on the broker, so set them as empty. I had to add "INFLUXDB = None" as that seems to be missing in config.rename.py

then i run

python3 dsmr-mqtt.py

which gives above log.

Any help appreciated !

hansij66 commented 1 year ago

Hi

On INFLUXDB...good catch...as I gitignore my config.py file....I guess I forgot to sync that last change to config,rename.py....Will fix that.

Wrt mqtt, I have never tested w/o username/password...not really recommended to run MQTT w/o authentication.

What you can try is to comment out in mqtt/mqtt.py the following line

self.__mqtt.username_pw_set(username, password)

I have just tested dsmr in simulation (with username and password for MQTT) ... and it works for me (I use mosquitto as MQTT broker)

On Sat, Jun 3, 2023 at 10:14 PM karlkashofer @.***> wrote:

I dont see any messages in MQTT Explorer, the broker is processing messages from various sensors around my house, all looking normal.

dsmr2mqtt also does not work with my real P1 probe, attached to Sagemcom and decoded by dsmr-proxy.

I presume there should be mqtt message log entries between all the

dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >> dsmr-mqtt.P1_parser DEBUG: FUNCTION:decode_telegrams LINE:188: >>

lines ?

What i did: git clone the repo on a raspberry pi zero with python3 and fresh paho-mqtt 1.6.1 set ip of mqtt broker, set production to false and loglevel to DEBUG. I have no username or password on the broker, so set them as empty. I had to add "INFLUXDB = None" as that seems to be missing in config.rename.py

then i run

python3 dsmr-mqtt.py

Any help appreciated ! run

— Reply to this email directly, view it on GitHub https://github.com/hansij66/dsmr2mqtt/issues/4#issuecomment-1575171219, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFFPZDZAVZIQOCU66U52KOLXJOLKVANCNFSM6AAAAAAYZOGOWE . You are receiving this because you commented.Message ID: @.***>

karlkashofer commented 1 year ago

Unfortunately, commenting the line does not help. I also use mosquitto on debian bullseye in docker.

Could you post the debug log for your simulation ?

karlkashofer commented 1 year ago

Ok, i got it working instantly on my debian bookworm laptop. Went back to the raspberry, saw that python3-persist-queue was not installed. did "sudo pip3 install persist-queue", now the test data is working.

However, still no luck with my P1 data. I have attached a small sample, can you see anything wrong with it ?

dsmr_kk.raw.txt

I get no data on the mqtt broker running this file as input in simulation mode. The only messages showing are:

dsmr-mqtt.mqtt.mqtt DEBUG: FUNCTION:do_publish LINE:444: >> TOPIC=dsmr/el; MESSAGE={"el_consumed":0.0,"el_returned":0.0,"timestamp":1685828093}

This is the raw data:

b'/EST5\\253740976_A\r\n\r\n1-3:0.2.8(50)\r\n0-0:1.0.0(230603233403S)\r\n1-0:1.8.0(000524862*Wh)\r\n1-0:1.8.1(000372282*Wh)\r\n1-0:1.8.2(000152580*Wh)\r\n1-0:1.7.0(000000362*W)\r\n1-0:2.8.0(000162361*Wh)\r\n1-0:2.8.1(000162307*Wh)\r\n1-0:2.8.2(000000054*Wh)\r\n1-0:2.7.0(000000000*W)\r\n1-0:3.8.0(000100705*varh)\r\n1-0:3.8.1(000093622*varh)\r\n1-0:3.8.2(000007083*varh)\r\n1-0:3.7.0(000000000*var)\r\n1-0:4.8.0(000284220*varh)\r\n1-0:4.8.1(000155403*varh)\r\n1-0:4.8.2(000128817*varh)\r\n1-0:4.7.0(000000370*var)\r\n!B35B\r\n'

hansij66 commented 1 year ago

I thought that I removed python3-persist-queue dependency in last version...let me check.

I will look tonight at your dsmr data

BR Hans

On Sat, Jun 3, 2023 at 11:28 PM karlkashofer @.***> wrote:

Ok, i got it working instantly on my debian bookworm laptop. Went back to the raspberry, saw that python3-persist-queue was not installed. did "sudo pip3 install persist-queue", now the test data is working.

However, still no luck with my P1 data. I have attached a small sample, can you see anything wrong with it ?

dsmr_kk.raw.txt https://github.com/hansij66/dsmr2mqtt/files/11644285/dsmr_kk.raw.txt

— Reply to this email directly, view it on GitHub https://github.com/hansij66/dsmr2mqtt/issues/4#issuecomment-1575203113, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFFPZD5YTBV6INAU7OQAEXLXJOUA3ANCNFSM6AAAAAAYZOGOWE . You are receiving this because you commented.Message ID: @.***>

karlkashofer commented 1 year ago

You are right, i did "pip3 uninstall persist-queue" and your test-data still works. Must have been changing too many thins at once...

Digging further into dsmr50.py i found out that ALL of my fields are different to yours. My timestamp has a S while yours has a W. My electricity fields have Wh while yours have kWh.

So after adapting all the regexes to my providers field definitions it now works !

Here is my dsmr50.py which works for the Austrian Electricity provider "Stromnetz Graz": dsmr50_Stromnetz_Graz_Austria.py.txt Feel free to include it in your repo if you want!

Thanks Hans for your support and great multi-threaded dsmr2mqtt !

hansij66 commented 1 year ago

I will add your file to the source code with the remark that that one worked in Austria. Thanks!

On Sun, Jun 4, 2023 at 11:20 AM karlkashofer @.***> wrote:

You are right, i did "pip3 uninstall persist-queue" and your test-data still works. Must have been changing too many thins at once...

Digging further into dsmr50.py i found out that ALL of my fields are different to yours. My timestamp has a S while yours has a W. My electricity fields have Wh while yours have kWh.

So after adapting all the regexes to my providers field definitions it now works !

Here is my dsmr50.py which works for the Austrian Electricity provider "Stromnetz Graz": dsmr50_Stromnetz_Graz_Austria.py.txt https://github.com/hansij66/dsmr2mqtt/files/11645244/dsmr50_Stromnetz_Graz_Austria.py.txt

Thanks Hans for your support and great multi-threaded dsmr2mqtt !

— Reply to this email directly, view it on GitHub https://github.com/hansij66/dsmr2mqtt/issues/4#issuecomment-1575484730, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFFPZDZ5AYDLH6J4Q5PDDETXJRHO5ANCNFSM6AAAAAAYZOGOWE . You are receiving this because you commented.Message ID: @.***>

hansij66 / dsmr2mqtt

No messages sent to mqtt broker ? #4