Scrape the entire text from page from entity extraction.

josiahcoad / Wanderland

For Travelers. By Travelers. A chrome extension to browse travel destinations across any webpage.

https://gowanderland.com

MIT License

6 stars 4 forks source link

Scrape the entire text from page from entity extraction. #12

Open josiahcoad opened 5 years ago

josiahcoad commented 5 years ago

Right now, only the "most important" text is scanned by Dandelion. We can send entire page text to Dandelion API as a POST... but we need to implement a text scraper to get all text from the webpage before sending to Dandelion.