Biliskn3r commented 1 week ago

Name of Council

Chelmsford

Issue Information

Chelmsford deleted Salesforce and their JSON data, it is now .PDF (urgh) and/or "this is your collection day"... lol. But we in CHM do not see any benefits from their cost cutting, pot holes still gaping the size of the moon, everywhere. https://www.chelmsford.gov.uk/bins-and-recycling/check-your-collection-day/ - is it easy to parse the HTML with BS4?

Verification

[X] I searched for similar issues at https://github.com/robbrad/UKBinCollectionData/issues?q=is:issue and found no duplicates
[X] I have checked my address/postcode/UPRN works on the council's website
[X] I have provided a detailed explanation of the issue as well as steps to replicate the issue
[X] I understand that this project is run by volunteer contributors therefore completion of this issue cannot be guaranteed

m26dvd commented 6 days ago

I've just test added Chelmsford City Council and it works okay for me? Can you recheck

URL to fetch collection data is "https://www.chelmsford.gov.uk/myhome/"

Biliskn3r commented 4 days ago

Thanks for testing. I realised I needed to deploy selenium and have done so, however, all it does is time-out:

[UKBinCollection] Unexpected error: Message: Stacktrace: #0 0x55c447ab8f83 #1 0x55c447771cf7 #2 0x55c4477c199e #3 0x55c4477c1aa1 #4 0x55c44780cd64 #5 0x55c4477eb0dd #6 0x55c44780a006 #7 0x55c4477eae53 #8 0x55c4477b2dd4 #9 0x55c4477b41de #10 0x55c447a7d531 #11 0x55c447a81455 #12 0x55c447a69f55 #13 0x55c447a820ef #14 0x55c447a4d99f #15 0x55c447aa6008 #16 0x55c447aa61d7 #17 0x55c447ab8124 #18 0x7f37e583aac3

I went through the list and found Sunderland (also using selenium) and tried a random address, it worked within a minute, so maybe the CHM website is completely broken (I'm intrigued at how yours worked!)

robbrad commented 4 days ago

Have a look at https://robbrad.github.io/UKBinCollectionData/3.12/2297/index.html#suites/98d3104e051c652961429bf95fa0b5d6/bd726796609c321b/

It took 6+ minutes - we have had an issue with this council before.

Try upping the timeout on the sensor

Biliskn3r commented 4 days ago

31% success rate for CHM. le sigh. These guys can't do anything right.

I've upped the sensor to 1000 seconds and will leave it overnight, hopefully someone on their end reboots something and fixes whatever performance issues they are having.

Good to see you still keeping this going / expanding this project @robbrad I remember you assisting when we were still in the home-assistant community forum/threads (and back when CHM council had better infrastructure!)

robbrad commented 4 days ago

31% success rate for CHM. le sigh. These guys can't do anything right.

I've upped the sensor to 1000 seconds and will leave it overnight, hopefully someone on their end reboots something and fixes whatever performance issues they are having.

Good to see you still keeping this going / expanding this project @robbrad I remember you assisting when we were still in the home-assistant community forum/threads (and back when CHM council had better infrastructure!)

Thanks for the recognition @Biliskn3r

I do remember that! O.G. Post is Jun 2018 😅

Biliskn3r commented 1 day ago

No good guys. From reading the other "bug" reports in the issues here, looks like the councils have yet again changed their website, and probably cost them more in hiring new IT ppl. Sigh.

Stacktrace:

0 0x55f998f3ef83

1 0x55f998bf7cf7

2 0x55f998c4799e

3 0x55f998c47aa1

4 0x55f998c92d64

5 0x55f998c710dd

6 0x55f998c90006

7 0x55f998c70e53

8 0x55f998c38dd4

9 0x55f998c3a1de

10 0x55f998f03531

11 0x55f998f07455

12 0x55f998eeff55

13 0x55f998f080ef

14 0x55f998ed399f

15 0x55f998f2c008

16 0x55f998f2c1d7

17 0x55f998f3e124

18 0x7fdf9f0e3ac3

m26dvd commented 1 day ago

Performance issue We are aware of an issue with the speed of finding results on myhome. We are working on it, but it currently may take around 30 seconds to return a result. We ask for your patience while we look into this issue.

This is the message on their website. I've had a look at the code and it still works, it's just very slow!

Biliskn3r commented 21 hours ago

do you get anything back when you enter postcode CM1 1GN, flat number can be anything, '1' for example?

m26dvd commented 17 hours ago