search

Tristan296 / Catchy

2 stars 0 forks source link

Duplicate Product Cards & Missing found products #2

Closed Tristan296 closed 9 months ago

Tristan296 commented 9 months ago

When searching for coffee machines: The following results are found:

Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/products/hario_grinder_500x500.png?v=1579689219
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/hario-coffee-mill-column-wood
Image src: https://baristawarehouse.com.au/cdn/shop/products/hario_grinder_500x500.png?v=1579689219
Image alt: hario coffee grinder column - wood, simple, hario - barista warehouse
Price: $68.90

substring allowed for https://baristawarehouse.com.au/products/kinto-coffee-server is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Servers_90fb2625-5414-47bb-8d99-ed3b41bf6986.jpg?v=1684742214
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/kinto-coffee-server
Image src: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Servers_90fb2625-5414-47bb-8d99-ed3b41bf6986.jpg?v=1684742214
Image alt: coffee servers
Price: $21.90

substring allowed for https://baristawarehouse.com.au/products/rhino-coffee-tamper is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Tampers_5e4f976a-15d2-4b67-9944-82a69810da36.jpg?v=1684742290
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/rhino-coffee-tamper
Image src: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Tampers_5e4f976a-15d2-4b67-9944-82a69810da36.jpg?v=1684742290
Image alt: tampers
Price: $54.90

substring /collections/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/espresso-2-group-eco-carat-black-coffee-machine?variant=50854995285 is /products/.
Price couldn't be found. Trying to find the first price in the website using regex.
No price found on the website.
sublink tags: True
substring /collections/ not defined for com.
substring /collections/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/cime-co-11-coffee-machines is /products/.
Price couldn't be found. Trying to find the first price in the website using regex.
No price found on the website.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Cocoa-Shakers_aa4a4a9a-6e57-4818-b3ce-232725eab5d9.jpg?v=1684741428
sublink tags: True

substring allowed for https://baristawarehouse.com.au/products/coffee-gear-timer is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Portafilters_53065b00-9980-4b31-8e3d-ffcaaf30ce8a.jpg?v=1685948328
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/coffee-gear-timer
Image src: https://baristawarehouse.com.au/cdn/shop/files/Portafilters_53065b00-9980-4b31-8e3d-ffcaaf30ce8a.jpg?v=1685948328
Image alt: portafilters
Price: $17.95

substring allowed for https://baristawarehouse.com.au/products/cilio-classico-electric-coffee-maker is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/products/Cilio-Classico-Electric-Coffee-Maker_46001dde-f962-42d5-a1c2-7613f8a69c6c_665x665.jpg?v=1527378127
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/cilio-classico-electric-coffee-maker
Image src: https://baristawarehouse.com.au/cdn/shop/products/Cilio-Classico-Electric-Coffee-Maker_46001dde-f962-42d5-a1c2-7613f8a69c6c_665x665.jpg?v=1527378127
Image alt: cilio classico electric coffee maker, variable, cilio - barista warehouse
Price: $179.90

substring allowed for https://baristawarehouse.com.au/products/helor-coffee-grinder-contemporary-burr is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Grinder-Cleaner_2d2e2fa4-4648-434d-ac8b-c618db3084f8.jpg?v=1684744593
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/helor-coffee-grinder-contemporary-burr
Image src: https://baristawarehouse.com.au/cdn/shop/files/Grinder-Cleaner_2d2e2fa4-4648-434d-ac8b-c618db3084f8.jpg?v=1684744593
Image alt: grinder cleaner
Price: $339.00

substring allowed for https://baristawarehouse.com.au/products/pallo-coffee-wrench is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Servers_90fb2625-5414-47bb-8d99-ed3b41bf6986.jpg?v=1684742214
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/pallo-coffee-wrench
Image src: https://baristawarehouse.com.au/cdn/shop/files/Coffee-Servers_90fb2625-5414-47bb-8d99-ed3b41bf6986.jpg?v=1684742214
Image alt: coffee servers
Price: $24.90

substring allowed for https://baristawarehouse.com.au/products/aeropress-go-coffee-maker is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/aeropress-go-coffee-maker
Image src: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
Image alt: espresso machines
Price: $46.90

substring /collections/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/concept-art-cocoa-shaker-black-fine is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Cocoa-Shakers_aa4a4a9a-6e57-4818-b3ce-232725eab5d9.jpg?v=1684741428
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/concept-art-cocoa-shaker-black-fine
Image src: https://baristawarehouse.com.au/cdn/shop/files/Cocoa-Shakers_aa4a4a9a-6e57-4818-b3ce-232725eab5d9.jpg?v=1684741428
Image alt: cocoa shakers
Price: $9.95

substring /collections/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/isomac-pro-dual-boiler-pid-coffee-machines is /products/.
Price couldn't be found. Trying to find the first price in the website using regex.
No price found on the website.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
sublink tags: True
substring /collections/ not defined for com.
substring /blogs/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/bonavita-8-cup-one-touch-coffee-maker is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/products/Bonavita-Batch-8-Cup-Coffee-Brewer_600x600_d6739bbb-fe0f-41a5-a9f7-d75c07d2efc7_600x600.jpg?v=1665034378
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/bonavita-8-cup-one-touch-coffee-maker
Image src: https://baristawarehouse.com.au/cdn/shop/products/Bonavita-Batch-8-Cup-Coffee-Brewer_600x600_d6739bbb-fe0f-41a5-a9f7-d75c07d2efc7_600x600.jpg?v=1665034378
Image alt: bonavita 8 cup one-touch coffee maker
Price: $259.00

substring allowed for https://baristawarehouse.com.au/products/melitta-purista-automatic-coffee-machine is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/melitta-purista-automatic-coffee-machine
Image src: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
Image alt: espresso machines
Price: $799.00

substring /collections/ not defined for com.
substring allowed for https://baristawarehouse.com.au/products/isomac-tea-due-coffee-machines is /products/.
Price couldn't be found. Trying to find the first price in the website using regex.
No price found on the website.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
sublink tags: True

substring allowed for https://baristawarehouse.com.au/products/gaggia-classic-coffee-machine is /products/.
Found image with matching alt: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
sublink tags: True
Found Product details:
Link: https://baristawarehouse.com.au/products/gaggia-classic-coffee-machine
Image src: https://baristawarehouse.com.au/cdn/shop/files/Espresso-Machines_d5134b26-7aec-425e-9fd3-431105e6ffc7.jpg?v=1684746678
Image alt: espresso machines
Price: $899.00

However, only the following products are displayed:

image
Tristan296 commented 9 months ago

Fixed the issue, I had to pass the socketio parameter to process_sub_url from the flask app. the reason for this change is because whenever the product is found it needs to instantly send a message to the socketio rather than waiting for the extractor to finish.