jrkong / pySearch

Simple command line python script that opens a new browser tab to search the input string
BSD 3-Clause "New" or "Revised" License
4 stars 5 forks source link

Implement basic webcrawl capabilities #7

Open jrkong opened 5 years ago

jrkong commented 5 years ago

Look at Scrapy to implement basic webcrawling abilities to grab the first 3 results from a search and display them. If a user inputs a number it will open that link in a web browser.

jrkong commented 5 years ago

To add a little motivation and roadmapping, once this issue is solved we can use it to add dictionary lookup and maybe documentation lookup before opening up search results. Also, if this is implemented users can use the webcrawl mode to vet results and open them up in the browser directly.

humphd commented 5 years ago

Another option people use is BeautifulSoup https://medium.freecodecamp.org/how-to-scrape-websites-with-python-and-beautifulsoup-5946935d93fe

shreenaathia commented 5 years ago

Hey I'll work on this issue since no ones grabbed it yet !