Closed ITTV-tools closed 4 months ago
I can find the citys in the app
Hi. I have the same problem. It worked a week ago and suddenly all schedules are gone and the log states:
2024-04-18 22:19:46.575 ERROR (SyncWorker_3) [waste_collection_schedule.source_shell] fetch failed for source Apps by Abfall+:
Traceback (most recent call last):
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch
entries = self._source.fetch()
^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch
for d in self._app.generate_calendar():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 760, in generate_calendar
self.select_kommune()
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 500, in select_kommune
raise Exception(f"Region {self._region_search} not found.")
Exception: Region Bassum not found.
Tried downgrading to 1.46.0 ... no luck.
And also the same issue here for de.k4systems.abfallapploe
:
2024-04-18 22:42:30.382 ERROR (SyncWorker_8) [waste_collection_schedule.source_shell] fetch failed for source Apps by Abfall+:
Traceback (most recent call last):
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch
entries = self._source.fetch()
^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch
for d in self._app.generate_calendar():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 786, in generate_calendar
self.select_kommune()
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 502, in select_kommune
raise Exception(f"Region {self._region_search} not found.")
Exception: Region <XYZ> not found.
City, street and house number are defined exactly as in the app which worked until today morning. HA version: 2024.4.3 Waste collection version: 1.47.0
same here, HA version: 2024.4.3, Waste collection version: 1.47.0
2024-04-18 23:31:21.459 ERROR (SyncWorker_6) [waste_collection_schedule.source_shell] fetch failed for source Apps by Abfall+:
Traceback (most recent call last):
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch
entries = self._source.fetch()
^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch
for d in self._app.generate_calendar():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 786, in generate_calendar
self.select_kommune()
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 502, in select_kommune
raise Exception(f"Region {self._region_search} not found.")
Exception: Region XXXXX not found.
- name: app_abfallplus_de
args:
app_id: de.k4systems.meinawblm
Same here, HA Version: 2024.4.3, Waste collection Version 1.47.0
fetch failed for source Apps by Abfall+: Traceback (most recent call last): File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch entries = self._source.fetch() ^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch for d in self._app.generate_calendar(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 786, in generate_calendar self.select_kommune() File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 502, in select_kommune raise Exception(f"Region {self._region_search} not found.") Exception: Region Thierstein not found.
- name: app_abfallplus_de
args:
app_id: de.k4systems.kufiapp
Same here: waste_collection_schedule: sources:
I opened a separate Bugreport by mistake, I will close it right now.
Same on app_id: de.abfallwecker
Same problem app_id: de.k4systems.leipziglk city: Naunhof bezirk: Naunhof
HA Version 2024.4.3 --> it seems to be a problem with the new HA version
HA Version 2024.4.3 --> it seems to be a problem with the new HA version
I don't think so. My update to 2024.4.3. was done in 12th of April and waste collection schedule was working fine with this version until yesterday. And I didn't do any update on that time.
I use the ICS file form this Website now. Looks like the are using abfall.io https://www.awb-landkreis-rastatt.de/abfallkalender
waste_collection_schedule:
sources:
- name: ics
args:
url: https://api.abfall.io/?key=<key>&mode=export&idhousenumber=<number>&wastetypes=576,573,20,66,157,572&timeperiod={%Y}0101-{%Y}1231&showinactive=false&type=ics
I have created a PR to fix this. Looks like the servers are probing for the user-agent now. Tested with
- name: app_abfallplus_de
args:
app_id: de.k4systems.awbrastatt
city: Muggensturm
strasse: Adlergasse
@ReneNulschDE Perfect! I tried your code and works for me too...
Fixed by #1993 (thanks @ReneNulschDE)
This will be part of release 1.48.0 or is available now as master (git) version (3-dot menu -> redownload -> change version to master -> fully restart HA (this will increase update cycle by a lot)
Unfortunately it still doesn't work for me.
But the error hast changed:
Logger: waste_collection_schedule.source_shell Quelle: custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py:136 Integration: waste_collection_schedule (Dokumentation) Erstmals aufgetreten: 22:11:06 (1 Vorkommnisse) Zuletzt protokolliert: 22:11:06
fetch failed for source Apps by Abfall+: Traceback (most recent call last): File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch entries = self._source.fetch() ^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch for d in self._app.generate_calendar(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 795, in generate_calendar self.select_kommune() File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 493, in select_kommune regions = self.get_kommunen() ^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 471, in get_kommunen r.raise_for_status() File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
Correct, only solved for some of the apps. Needs more time to analyze the new flow.
Analysis so far:
Thanks @ReneNulschDE for your efforts. Much like the comment above from @daSchizo, this is still not working for me. I had that as a Q&A thread (#1991) is there a way to merge that here?
Hello. I have the same problem. Service is unknown since April 17, 2024. My values for Waste Collection Schedule:
waste_collection_schedule: sources:
Thank you for your support..
Saturday evening update, all test cases except "Bonn orange" are working, I have added some testcases based on the input in this issue. I will prepare a new PR now. (Bonn orange needs to be checked, maybe a different bin type)
Testing source app_abfallplus_de ...
found 36 entries for de.albagroup.app Braunschweig Hauptstraße 7A
de.k4systems.bonnorange Auf dem Hügel failed: Street 'Auf dem Hügel' not found., available: []
found 192 entries for de.ucom.abfallavr Brühl Habichtstr. 4A
found 66 entries for de.k4systems.abfallappwug Bergen hauptstr. 1
found 109 entries for de.k4systems.abfallappcux Wurster Nordseeküste Aakweg Alle Hausnummern
found 57 entries for de.abfallwecker Mutzschen, Am Lindigt 1
found 66 entries for de.k4systems.leipziglk Brandis Brandis
found 91 entries for de.k4systems.lkgoettingen, Abfallwirtschaft Altkreis Göttingen, Adelebsen, Alle Straßen
found 65 entries for de.k4systems.zakb Fürth Ahornweg 3
found 289 entries for de.k4systems.avea Leverkusen Haberstr.
found 52 entries for de.k4systems.abfallappog Bad Peterstal-Griesbach alle Straßen
found 79 entries for de.k4systems.abfallappfuerth Großhabersdorf Am Dürren Grund 1 a
found 87 entries for de.k4systems.awbgp Bad Boll Ahornstraße Alle Hausnummern
found 157 entries for de.k4systems.abfalllkbz Hoyerswerda bezirk: WK VIII
found 77 entries for de.idcontor.abfallwbd Duisburg, Rahm Am Junkersknappen 6
found 141 entries for de.k4systems.awbrastatt Muggensturm Adlergasse
Confirmed working again for de.k4systems.abfallappbh. Thanks @ReneNulschDE
Additional note: Bonn Orange needs the parameter "city" with the first letter of the street as value.
Testing source app_abfallplus_de ...
found 97 entries for de.k4systems.bonnorange Auf dem Hügel
Since yesterday I have the same problem for Nüdlingen. Here my configuration:
waste_collection_schedule:
sources:
- name: app_abfallplus_de
args:
app_id: de.k4systems.abfallscout
city: Nüdlingen
bezirk: Nüdlingen
strasse: Alle Straßen
I already did a reload with changing to master, but this didn't help.
You have to wait until the PR #2001 got merged into the master branch and then check again. I tested your config in my env and it is working.
Sounds good. Thank you very much! Any idea when it is merged / how long it will last?
Thank you @ReneNulschDE
Tried to use de.k4systems.abfallinfoapp with city Hellenthal, but still get 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
Please see here
Just merged fix v2 (#2001) from @ReneNulschDE:
This fix will be part of release 1.48.0 or is available now as master (git) version (3-dot menu -> redownload -> change version to master -> fully restart HA (this will increase update cycle by a lot)
Just merged fix v2 (#2001) from @ReneNulschDE:
This fix will be part of release 1.48.0 or is available now as master (git) version (3-dot menu -> redownload -> change version to master -> fully restart HA (this will increase update cycle by a lot)
I tried it with the redownload (master) and a full restart, but this didn't help here. Hacs shows me that version "f4be28d" is installed but the sensors are all "unknown". Also the calendar "Apps by Abfall+" is empty.
For me it worked. I manually added the changes of the PR and get values again for de.k4systems.abfallapploe
.
Many thanks for the fix!
@threadstone83 : Let me check it. It worked on Sunday for sure.
@ReneNulschDE if you need something (logs,...) just tell me.
All test cases failing again...
Testing source app_abfallplus_de ...
de.albagroup.app Braunschweig Hauptstraße 7A failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.k4systems.bonnorange Auf dem Hügel failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.ucom.abfallavr Brühl Habichtstr. 4A failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.k4systems.abfallappwug Bergen hauptstr. 1 failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.k4systems.abfallappcux Wurster Nordseeküste Aakweg Alle Hausnummern failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.abfallwecker Mutzschen, Am Lindigt 1 failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/bundesland/
de.k4systems.leipziglk Brandis Brandis failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
de.k4systems.lkgoettingen, Abfallwirtschaft Altkreis Göttingen, Adelebsen, Alle Straßen failed: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/landkreis/
@SuperMasterPhoenix : Could you share your config?
Sorry, just did a restart and now it's failing for me, too :(
Looks like we are playing cat and mouse. But the mouse expected the next move and prepared something already... Could someone check this code for the waste_collection_schedule/service/AppAbfallPlusDe.py before I create the next PR?
Testing source app_abfallplus_de ...
found 36 entries for de.albagroup.app Braunschweig Hauptstraße 7A
found 97 entries for de.k4systems.bonnorange Auf dem Hügel
found 192 entries for de.ucom.abfallavr Brühl Habichtstr. 4A
found 66 entries for de.k4systems.abfallappwug Bergen hauptstr. 1
found 109 entries for de.k4systems.abfallappcux Wurster Nordseeküste Aakweg Alle Hausnummern
found 56 entries for de.abfallwecker Mutzschen, Am Lindigt 1
found 66 entries for de.k4systems.leipziglk Brandis Brandis
found 91 entries for de.k4systems.lkgoettingen, Abfallwirtschaft Altkreis Göttingen, Adelebsen, Alle Straßen
found 65 entries for de.k4systems.zakb Fürth Ahornweg 3
found 289 entries for de.k4systems.avea Leverkusen Haberstr.
found 52 entries for de.k4systems.abfallappog Bad Peterstal-Griesbach alle Straßen
found 79 entries for de.k4systems.abfallappfuerth Großhabersdorf Am Dürren Grund 1 a
found 87 entries for de.k4systems.awbgp Bad Boll Ahornstraße Alle Hausnummern
found 157 entries for de.k4systems.abfalllkbz Hoyerswerda bezirk: WK VIII
found 77 entries for de.idcontor.abfallwbd Duisburg, Rahm Am Junkersknappen 6
found 141 entries for de.k4systems.awbrastatt Muggensturm Adlergasse
not sure how long I would like to be the mouse... If someone has a better idea let me know. In case the vendor is reading this too --> let us know what the problem is.
@ReneNulschDE: Just tested your fixed code, works for me :-), thanks!
This version also works for me. It would be too bad if the vendor continued to try to prevent the use of their APIs.
@ReneNulschDE: Habe gerade deinen festen Code getestet, funktioniert bei mir :-), danke!
Was hast du genau verändert? Danke für deine Hilfe.
@schmidt-mai-marcel : Diff is here. Added the app specific user-agent headers...
I've tested it with the latest "master" version. It did not work for me.
Protokolldetails (FEHLER) Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht Logger: waste_collection_schedule.source_shell Quelle: custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py:136 Integration: waste_collection_schedule (Dokumentation) Erstmals aufgetreten: 21:07:08 (1 Vorkommnisse) Zuletzt protokolliert: 21:07:08
fetch failed for source Apps by Abfall+: Traceback (most recent call last): File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch entries = self._source.fetch() ^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 159, in fetch for d in self._app.generate_calendar(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 786, in generate_calendar self.select_kommune() File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 484, in select_kommune regions = self.get_kommunen() ^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 462, in get_kommunen r.raise_for_status() File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://app.abfallplus.de/assistent/kommune/
@daSchizo : Please do not use the latest master. Please see this comment.
@schmidt-mai-marcel: Diff ist hier . App-spezifische User-Agent-Header hinzugefügt...
Danke für den Link. Wo muss man diesen Code einfügen?
@schmidt-mai-marcel :
Danke für den Link. Wo muss man diesen Code einfügen?
Der Code aus dem link muß in der Datei HA-Config-Folder/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py
eingefügt werden. (alles ersetzen) - Wenn Du damit wenig Erfahrung hast, erstelle dir eine Sicherung...
@schmidt-mai-marcel:
Danke für den Link. Wo muss man diesen Code einfügen?
Der Code aus dem Link muss in die Datei
HA-Config-Folder/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py
eingefügt werden. (alles ersetzen) - Wenn Du damit wenig Erfahrung hast, erstelle Dir eine Sicherung...
Danke für deine super Hilfe. Wenig Erfahrung habe ich ;-) bis jetzt lief immer alles. Ich kann die Datei HA-Config-... nicht finden
The "HA-Config-Folder" is a placeholder for your folder where you store the HA-configuration. If you do not know where your config folder is, I prefer that you wait until the code is part of this solution and you can then use the normal update procedures.
Der „HA-Config-Folder“ ist ein Platzhalter für Ihren Ordner, in dem Sie die HA-Konfiguration speichern. Wenn Sie nicht wissen, wo sich Ihr Konfigurationsordner befindet, warten Sie lieber, bis der Code Teil dieser Lösung ist, und können dann die normalen Aktualisierungsverfahren verwenden.
Danke Rene, habe den Ordner gefunden und den Code eingefügt. Gebe noch Bescheid ob es im Anschluss wieder läuft.
Läuft wieder, ganz tolle Arbeit! Vielen Dank für den Support
@ReneNulschDE Tried also your new fix and it also worked for me. Many thanks for your effort. Hopefully this lasts a while.
I have tried the new code and get this Failure:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: waste_collection_schedule.source_shell Quelle: custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py:136 Integration: waste_collection_schedule (Dokumentation) Erstmals aufgetreten: 06:31:12 (1 Vorkommnisse) Zuletzt protokolliert: 06:31:12
fetch failed for source Apps by Abfall+: Traceback (most recent call last): File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch entries = self._source.fetch() ^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch for d in self._app.generate_calendar(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 885, in generate_calendar self.init_connection() File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 478, in init_connection self._request("config.xml", base=API_BASE, data=data).raise_for_status() File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://app.abfallplus.de/config.xml
My config:
- name: app_abfallplus_de
args:
app_id: de.k4systems.kufiapp
city: Thierstein
strasse: Sonnenstraße
hnr: xxx
same for me:
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch
entries = self._source.fetch()
^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch
for d in self._app.generate_calendar():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 885, in generate_calendar
self.init_connection()
File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 478, in init_connection
self._request("config.xml", base=API_BASE, data=data).raise_for_status()
File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://app.abfallplus.de/config.xml
my config:
waste_collection_schedule:
sources:
- name: app_abfallplus_de
args:
app_id: de.abfallwecker
city: Wehingen
strasse: Alle Straßen
bundesland: Baden-Württemberg
landkreis: Kreis Tuttlingen
The official app currently isn't working, too, so there seems to be some maintenance ongoing...
Hi, same for me:
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: waste_collection_schedule.source_shell Quelle: custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py:136 Integration: waste_collection_schedule (Dokumentation) Erstmals aufgetreten: 07:53:33 (1 Vorkommnisse) Zuletzt protokolliert: 07:53:33
fetch failed for source Apps by Abfall+: Traceback (most recent call last): File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source_shell.py", line 134, in fetch entries = self._source.fetch() ^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/source/app_abfallplus_de.py", line 140, in fetch for d in self._app.generate_calendar(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 786, in generate_calendar self.select_kommune() File "/config/custom_components/waste_collection_schedule/waste_collection_schedule/service/AppAbfallplusDe.py", line 502, in select_kommune raise Exception(f"Region {self._region_search} not found.") Exception: Region Oberkrämer not found.
Config:
waste_collection_schedule: sources:
I Have A Problem With:
A specific source
What's Your Problem
I want to use de.k4systems.awbrastatt. I tried several citys. Muggensturm, Bühl, Bühlertal. But the log always says the region was not found.
I tried serveral config. With City and street and without street. But always the same error.
Source (if relevant)
No response
Logs
Relevant Configuration
Checklist Source Error
Checklist Sensor Error
Required