search

WayneRose-95 / job-scraper-

Repository to extract jobs from various websites
0 stars 0 forks source link

Issue 18 main.py integration #19

Closed WayneRose-95 closed 1 month ago

WayneRose-95 commented 1 month ago

S3 Upload Integration

https://github.com/WayneRose-95/job-scraper-/commit/4cb8d6b3bb6f3607e371e7784c9a1a75d6643027

Adding Create Job Database

https://github.com/WayneRose-95/job-scraper-/commit/05803e5ae8ea203d0177fad6f79604ea37a75dd1

Adding function to update dimension tables for loading

https://github.com/WayneRose-95/job-scraper-/commit/03b1c75d7d408dfede7e5510738503e049582788

Adding in logic for second and future loads of data.

https://github.com/WayneRose-95/job-scraper-/commit/c8e28e10ca9d8eb4affd230b9b2432f08ac249a2

Refactoring main.py to add configuration files

https://github.com/WayneRose-95/job-scraper-/commit/f64c314085c121fcc0724923da3fa22ddcb6dcec

Addressing Bugfixes

https://github.com/WayneRose-95/job-scraper-/commit/205587556f262ebd4b82483aa664ae965eccef27

https://github.com/WayneRose-95/job-scraper-/commit/644d428749d4d6acb56cb6ece802d176954598b3