Closed karthikbhandary2 closed 1 year ago
Hi, I'm Babar Rasheed (Contributor GSSOC'23) Many websites don't offer API so to tackle this we can use Web Scraping to access data in easy and structured manner. Python libraries like bs4, BeautifulSoup, Scrapy, Selenium, etc. are generally used for web scraping. Here I'm willing to apply these libraries and use an effective way of Multiprocessing to speed up Web Scraping. Multiprocessing is very helpful when multiple URLs are scraped to get the data. It will perform scraping on multiple URLs thus saving our time.
Approach:
users/{user_id}
endpoint and extracting the media_count
field from the response.Go ahead @karthikbhandary2
There is an error in the following()
method. I am following 560 accounts on Instagram but it is showing it as 108.
I've observed that the meta tag is not showing the following count. I can change the code so as to show a msg saying "Following count not available" or should I do something else? @nikhil25803
Is your feature request related to a problem? Please describe. Currently, the Instagram scrap_up only has two methods to get the followers' count and the following count. I would like to add a new method to get the post count.
Describe the solution you'd like I will be using beautiful soup to do this.