pranjay-poddar / Dev-Geeks

open source project
https://devgeeks-os.netlify.app/repository_web_page/
MIT License
605 stars 823 forks source link

Github web scrapping #2886

Closed Abhinavcode13 closed 1 year ago

Abhinavcode13 commented 1 year ago

GitHub scraping involves extracting data from GitHub repositories, user profiles, or other GitHub-related pages. It can be done using programming languages like Python by utilizing libraries such as Requests for making HTTP requests, Beautiful Soup for parsing HTML, and interacting with the GitHub API to access specific data. The process typically involves sending HTTP requests to GitHub, retrieving the HTML content of the desired pages, parsing the HTML to extract the desired information using HTML parsing libraries, and then using the extracted data for analysis, visualization, or other purposes. However, it's important to ensure that you comply with the terms of service and usage policies of GitHub and respect any rate limits or restrictions imposed by the platform.

Abhinavcode13 commented 1 year ago

Please assign this issue to me @MohitGupta121