Weather Underground proxy issues?

toxic0berliner commented 3 months ago

System Health details

System Information

version	core-2024.8.3
installation_type	Home Assistant OS
dev	false
hassio	true
docker	true
user	root
virtualenv	false
python_version	3.12.4
os_name	Linux
os_version	6.6.46-haos
arch	x86_64
timezone	Europe/Paris
config_dir	/config

Home Assistant Community Store

Home Assistant Cloud

Home Assistant Supervisor

Dashboards

Recorder

Checklist

[X] I have enabled debug logging for my installation.
[X] I have filled out the issue template to the best of my ability.
[X] This issue only contains 1 issue (if you have multiple issues, open one issue for each issue).
[X] This issue is not a duplicate issue of any previous issues..

Describe the issue

I have both WC and WU setup with the proxy checkbox enabled and the correct credentials setup, I see both devices and their sensors in HA WC is receiving my data and it's visible on their site But WU claims m'y device is offline. I just created my accounts today but gave it several hours and still nothing. I do see the requests to both WU and WC in my Caddy logs but I can't seem to find how to get more logs as to why the WU one in not being forwarded while WC is.

Reproduction steps

No real clue sorry

Debug logs

Shows nothing about weather underground sadly

Diagnostics dump

No response

lhw commented 2 months ago

I'll check on WU when I am back home and able to configure my weather station. Maybe there were changes. Could you add a logging block to the caddy instance and post the anonymized log? Maybe this can already give some insights. Like this:

http://rtupdate.wunderground.com {
  @weatherstation {
    path /weatherstation/updateweatherstation.php*
  }
  log {
    output file /data/logs/wunderground.log
  }
  reverse_proxy @weatherstation http://<homeassistant> {
    rewrite /wunderground{uri}
    header_up "Authorization" "Bearer {env.HA_ACCESS_TOKEN}"
  }
}

Remember to remove ID/Password from the whole json.

toxic0berliner commented 2 months ago

I already had logs to stdout as it's running in docker, This is what's being logged

{"level":"info","ts":1725987083.1423686,"logger":"http.log.access.log0","msg":"handled request","request":{"remote_ip":"10.0.0.6","remote_port":"52017","client_ip":"10.0.0.6","proto":"HTTP/1.1","method":"GET","host":"rtupdate.wunderground.com","uri":"/weatherstation/updateweatherstation.php?ID=XXX&PASSWORD=XXX&dateutc=2024-9-10+17%3A51%3A18&baromin=30.11&tempf=68.0&humidity=52&dewptf=49.5&rainin=0&dailyrainin=0&winddir=30&windspeedmph=0&windgustmph=0&UV=0&solarRadiation=42.0","headers":{"User-Agent":["lwIP/2.1.2"],"Accept":["*/*"],"Connection":["Close"]}},"bytes_read":0,"user_id":"","duration":0.335355641,"size":2,"status":200,"resp_headers":{"Content-Length":["2"],"Date":["Tue, 10 Sep 2024 16:51:23 GMT"],"Content-Type":["text/plain; charset=utf-8"],"Referrer-Policy":["no-referrer"],"X-Content-Type-Options":["nosniff"],"Server":["Caddy",""]}}{"level":"info","ts":1725987089.1556892,"logger":"http.log.access.log0","msg":"handled request","request":{"remote_ip":"10.0.0.6","remote_port":"52018","client_ip":"10.0.0.6","proto":"HTTP/1.1","method":"GET","host":"rtupdate.wunderground.com","uri":"/weatherstation/updateweatherstation.php?ID=XXX&PASSWORD=XXX&dateutc=2024-9-10+17%3A51%3A18&baromin=30.11&tempf=68.0&humidity=52&dewptf=49.5&rainin=0&dailyrainin=0&winddir=30&windspeedmph=0&windgustmph=0&UV=0&solarRadiation=42.0","headers":{"User-Agent":["lwIP/2.1.2"],"Accept":["*/*"],"Connection":["Close"]}},"bytes_read":0,"user_id":"","duration":0.134580794,"size":2,"status":200,"resp_headers":{"Date":["Tue, 10 Sep 2024 16:51:29 GMT"],"Content-Type":["text/plain; charset=utf-8"],"Referrer-Policy":["no-referrer"],"Server":["Caddy",""],"X-Content-Type-Options":["nosniff"],"Content-Length":["2"]}}{"level":"info","ts":1725987095.9467916,"logger":"http.log.access.log0","msg":"handled request","request":{"remote_ip":"10.0.0.6","remote_port":"52019","client_ip":"10.0.0.6","proto":"HTTP/1.1","method":"GET","host":"rtupdate.wunderground.com","uri":"/weatherstation/updateweatherstation.php?ID=XXX&PASSWORD=XXX&dateutc=2024-9-10+17%3A51%3A18&baromin=30.11&tempf=68.0&humidity=52&dewptf=49.5&rainin=0&dailyrainin=0&winddir=30&windspeedmph=0&windgustmph=0&UV=0&solarRadiation=42.0","headers":{"User-Agent":["lwIP/2.1.2"],"Accept":["*/*"],"Connection":["Close"]}},"bytes_read":0,"user_id":"","duration":0.113081218,"size":2,"status":200,"resp_headers":{"Content-Type":["text/plain; charset=utf-8"],"Server":["Caddy",""],"Referrer-Policy":["no-referrer"],"X-Content-Type-Options":["nosniff"],"Content-Length":["2"],"Date":["Tue, 10 Sep 2024 16:51:35 GMT"]}}

Haven't looked at the details, my station seems to be making 3 requests to WU in a row every time, only a single request to WeatherCloud is logged, strange but hey...

Also wondering, maybe my unit is defective but I'm picking up very little wind, so I was wondering if there might not be a missing conversion from mph that is being sent to WU and intercepted by this integration to kmh that my home assistant is setup to display, but that's probably another issue, and I actually think my device might be broken...

lhw commented 2 months ago

Haven't looked at the details, my station seems to be making 3 requests to WU in a row every time, only a single request to WeatherCloud is logged, strange but hey...

The equests in a row also appear on my station (Up to 5 in my case). Might be their solution to broken connections. WU will ignore anything below 10min anyway.

Also wondering, maybe my unit is defective but I'm picking up very little wind, so I was wondering if there might not be a missing conversion from mph that is being sent to WU and intercepted by this integration to kmh that my home assistant is setup to display, but that's probably another issue, and I actually think my device might be broken...

I can't be quite sure that all the conversions are correct. Try double checking with the Weathercloud.net device if you have both forwarding to your station. On mine it looks fairly correct, with more spikes on weathercloud due to it updating a lot more often: grafik vs WeatherUnderground grafik (note the different y-scale)

toxic0berliner commented 2 months ago

guess who's the dumb-dumb plugging the wind-sensing device onto the wind-direction post... so my device is now "fixed" and all sensors report fine in HA. Sadly WU still shows offline, will be quite a long time before I have the accesses and time to setup some network logging and inspect the actual http request to see if something's wrongly sent out by thin integration in HA.

lhw / cloudweatherproxy