search

knox-academy / webscraping

0 stars 0 forks source link

Test the web scraper to ensure it is functioning correctly and storing data in the S3 bucket. #37

Closed knox-academy closed 1 year ago

knox-academy commented 1 year ago

Mike McConnelly: Thank you for your feedback, Dan. I agree that specifying the expected outcome for each step is important, and we should also consider testing the web scraper's performance and speed. Here is the updated issue title and contents:

Issue Title: Test the web scraper for functionality, performance, and speed

Issue Contents:

  1. Test the web scraper to ensure it can scrape data without any errors. The expected outcome is that the scraper should be able to scrape data without any issues.
  2. Test the web scraper to ensure it is storing data in the S3 bucket correctly. The expected outcome is that the data should be stored in the correct format and location.
  3. Test the web scraper's performance by scraping a large amount of data and measuring the time it takes to complete the task. The expected outcome is that the scraper should be able to handle large amounts of data without slowing down the system.
  4. Test the web scraper's speed by scraping a small amount of data and measuring the time it takes to complete the task. The expected outcome is that the scraper should be able to complete the task quickly.

Let's get started on testing the web scraper and ensure it is functioning correctly and efficiently.