WWLLN - Data source discontinued

[sgofferj]

@bachya It appears, the WWLLN data source, which the HA WWLLN integration uses, has been discontinued.

I recently noticed error messages like this

2020-05-21 11:42:14 ERROR (MainThread) [homeassistant.components.wwlln.geo_location] Error while updating WWLLN data: Recurring request error from http://wwlln.net/new/map/data/current.json: 404, message='Not Found', url='http://wwlln.net/new/map/data/current.json

on HA startup and went through the WWLLN website. The URL for the map from which the integration used the data, http://wwlln.net/new/map/, shows a notice that the map has been disabled. The "Data" page to which the home page of the project refers, says

WWLLN Data are available via internet with cadence every 10 minutes for research purposes from the University of Washington, or with a cadence of as fast as every minute (i.e. in realtime) from our commercial reseller.

Unless the HA team can work something out with UWa, I guess, that was it with WWLLN.

[probot-home-assistant[bot]]

Hey there @bachya, mind taking a look at this issue as its been labeled with a integration (wwlln) you are listed as a codeowner for? Thanks! _{^{(message by CodeOwnersMention)}}

[tikismoke]

In domogik they are using those source for this information: Blitzortung.org Could we hope a new integrations?

[bachya]

@tikismoke I would love to integrate the Blitzortung data (since it is near-realtime and websocket-based), but a past experiment with it revealed some security controls that I couldn't get around. Later, I found this forum post, which makes it clear that an approved way to extract this data from blitzortung.org is unlikely to ever come:

• Our real-time and archived data can also be used for external projects.
• The project may not represent commercial interests.
• It must be of general interest for the participants of Blitzortung.org.
• It must be different from existing projects. Do not just reimplement other projects. Do not setup yet another visualization of online data.
• All applications that use our data must be freely accessible.
• The source of the data must be clearly identified.
• The operator must prevent any possible misuse of the data provided, as far as this is possible.
• The applications (web sites, apps, ...) have to retrieve their data from a separate server and not from the servers of Blitzortung.org. All data remain under the CC-BY-SA 4.0 license.

...and...

As for any 'full API' availability, No, not presently, and is unlikely ever to be available.

[tikismoke]

@bachya craps...

Going to see those esphome device mentioned in community forum :( it was so easy without to buy anythings and consume power for so less.

[Molodax]

@bachya perhaps you've seen it already but I'll post it just in case this API can substitute: https://community.home-assistant.io/t/lightning-tracker-wwlln-replacement-lightning-api-from-api-weather-mg/198288

[bachya]

@Molodax I’ll take a look. Thank you!

[atxbyea]

I did send a mail to Professor Bob

`Hi Professor.

I'm reaching out to you because I have noticed the integration I use for lightning monitor has been left hanging.

I currently use a software called Home Assistant to manage my whole house, someone made a integration that fetched data from your project to monitor lightning strikes, but the URL seems to have been removed. http://wwllln.net/new/map/data/current.json

Is there some legal reasons for this? Lack of bandwidth or other? Is there something I or we can do to keep this service online?

https://www.home-assistant.io/ https://www.home-assistant.io/integrations/wwlln/

`

Dear Eirik, Thank you for asking about WWLLN data. We are considering if, and how to continue to provide free WWLLN data. WWLLN is a self supporting research activity managed and copyrighted by the University of Washington; we receive no federal, state or private grants for operations, which are all paid for by data sales. How did you use our data from the current.json file? Would you be willing to help keep WWLLN alive with a nominal membership fee? Sincerely, Bob Holzworth

[atxbyea]

@tikismoke I would love to integrate the Blitzortung data (since it is near-realtime and websocket-based), but a past experiment with it revealed some security controls that I couldn't get around. Later, I found this forum post, which makes it clear that an approved way to extract this data from blitzortung.org is unlikely to ever come:

• Our real-time and archived data can also be used for external projects.
• The project may not represent commercial interests.
• It must be of general interest for the participants of Blitzortung.org.
• It must be different from existing projects. Do not just reimplement other projects. Do not setup yet another visualization of online data.
• All applications that use our data must be freely accessible.
• The source of the data must be clearly identified.
• The operator must prevent any possible misuse of the data provided, as far as this is possible.
• The applications (web sites, apps, ...) have to retrieve their data from a separate server and not from the servers of Blitzortung.org. All data remain under the CC-BY-SA 4.0 license.

...and...

As for any 'full API' availability, No, not presently, and is unlikely ever to be available.

How hard would it be to host that data ourselves mayhaps ? Is it a large dataset ? I wouldn't be against hosting a copy on any of my systems, if it was auto-maintaining itself.

[WeaselBreath]

Disappointing that this component has been discontinued. It was really nice to get a TTS message and push notification when lightning strikes were within 5 miles of my home. This may be the DIY solution if you want to resume the service and get data / lightning warnings in real time without the time delays w/ WWLLN. https://esphome.io/components/sensor/as3935.html Sensor can be purchased from China for as low as US $16.