search

BigDataIA-Fall2024-TeamA2 / Assignment3

0 stars 0 forks source link

Scraping Data: Extract data #6

Closed mubinmodi closed 2 weeks ago

mubinmodi commented 2 weeks ago

Scrape Data: Extract data from CFA Institute Research Foundation Publications. Retrieve details like Title, image, brief summary, and PDF file from each publication.

mubinmodi commented 2 weeks ago

Done, Had issues with beautiful soup, The issue seems to be related to the webpage's content being loaded dynamically with JavaScript, which requests and BeautifulSoup can't handle directly.

so instead used selenium