Refactor Configuration files to External Config File

[shri30yans]

Currently, the main config, product and website configurations are hardcoded, making it difficult to manage and update. We should refactor this into a separate configuration file to improve maintainability, reduce clutter in the code, and allow for easier updates in the future.

Proposed Solution:

• Create an external configuration file (e.g., config.yaml) to store product information.

• Modify the Python code to load product details from these configuration file instead of hardcoding them in the Python file.

  Files to be refactored

• Scrapper Config Scrapper settings

• Product Config Each product info

• Website Config Each website info

• main.py Products to check for

• Website Configuration has headers for each website. Extract this into a separate configuration file.

• Website Configuration for Amazon has wishlist products. Separate WebsiteConfig and Wishlist Products. (e.g., One solution could be making Amazon Wishlist a separate website with it's own product config.)

Steps to Implement:

1. Create a new configuration file (e.g., products_config.yaml and website_config.yaml).
2. Move all product/website data into this configuration file.
3. Modify the existing Python file to parse and load the configuration at runtime.
4. Test to ensure that functionality remains the same and all products are correctly loaded from the configuration file.

Additional Considerations:

• Ensure that the configuration file format is easy to update.
• Document the new configuration file format and explain how to add or update products.

Benefits:

• Improved maintainability.
• Reduced code duplication.
• Easier to update or add new products without modifying Python code directly.

[Spinicle]

Please assign this issue to me!

[shri30yans]

!assign @Spinicle

[bunsamosa-bot[bot]]

Hey @shri30yans! The timer for the @Spinicle to work on the issue has finished, deassign and assign a new contributor or extend the current timer. Contact maintainer leads if inactive @DedLad @polarhive @achyuthcodes30

[Spinicle]

I need an extension, had gone for dinner for about 25 minutes.

[shri30yans]

!assign @Spinicle

[bunsamosa-bot[bot]]

Hey @shri30yans! The timer for the @Spinicle to work on the issue has finished, deassign and assign a new contributor or extend the current timer. Contact maintainer leads if inactive @DedLad @polarhive @achyuthcodes30

[Spinicle]

Can I get reassigned? Still working on this, it's a tad bit long

[shri30yans]

!deassign @Spinicle

[shri30yans]

!assign @Spinicle

[Spinicle]

I'm a little sick and it wasn't helping whatsoever with this complex thing.

[bunsamosa-bot[bot]]

Hey @shri30yans! The timer for the @Spinicle to work on the issue has finished, deassign and assign a new contributor or extend the current timer. Contact maintainer leads if inactive @DedLad @polarhive @achyuthcodes30

[shri30yans]

@Spinicle Let me know if you need help. Which room are you in? Let's complete it.

[Spinicle]

Hey! Yeah so as much as I'd love to work on this, it's a little too much for me at the moment so I thought about doing another issue, but the bot isn't assigning me. Could you de-assign? I will get back to this later if it isn't already taken up someone

[shri30yans]

!deassign

[shri30yans]

Seems like you are already deassigned. Let me know if there is a issue.

[Spinicle]

Seems like you are already deassigned. Let me know if there is a issue.

I'm not able to be assigned to another issue. Been trying for a while now

[shri30yans]

!assign @Spinicle

[shri30yans]

!deassign @Spinicle

[MeghanaK11]

Can I get assigned to this issue

[shri30yans]

!assign @MeghanaK11

[bunsamosa-bot[bot]]

Hey @shri30yans! The timer for the @MeghanaK11 to work on the issue has finished, deassign and assign a new contributor or extend the current timer. Contact maintainer leads if inactive @DedLad @polarhive @achyuthcodes30