mgmgpyaesonewin / web-crawler-assignment

0 stars 0 forks source link

[Bug] When a keyword scrapping has failed, the keyword is lost #12

Open malparty opened 3 months ago

malparty commented 3 months ago

Issue

When the CSV file is uploaded, the keywords are not stored or displayed to the users.

This means that if any error occurs during the scrapping process (from frontend to backend to spider and back), the application might just "lose" some keywords on the way.

As a result, there is no way for the application to restart a failed scrapping.

Expected

When a keyword scrapping task raises an error, the user should see the keyword with a different status (e.g. failed or trying again).