search

WayneRose-95 / job-scraper-

Repository to extract jobs from various websites
0 stars 0 forks source link

main.py integration #18

Open WayneRose-95 opened 5 hours ago

WayneRose-95 commented 5 hours ago

Integration of class code into main.py script

The following classes need to be integrated into main.py

DataFrameManipulation , S3DataProcessing and DatabaseOperations

For S3DataProcessing to work, an S3 bucket with an appropriate IAM user must be configured / created.

WayneRose-95 commented 3 hours ago

Integration of first ETL load completed here via this commit

https://github.com/WayneRose-95/job-scraper-/commit/49a0a969f039a33632cdaded65daeebc5cf6ab60