search

SpencerLee / Huntr

NWhacks 2016 project. Job application tracking web app.
4 stars 0 forks source link

Improve performance of company autofill when creating a new job #3

Open renniehaylock opened 8 years ago

renniehaylock commented 8 years ago

Right now the functionality is really really buggy... mainly because we are making a call on every keystroke... which, when it works, seems to be a really cool feature... I can't see any other way of fixing this besides serving all that info from our own servers.... This means that we'll need to crawl Glassdoor's website to get all the companies... either that, or maybe adding a "search button", to only make the search when the user clicks it...

SamirMarin commented 8 years ago

I was looking at this one, and I think we do only have the option to either crawl the website.. Or just have have a search button the glass door api won't do a get all companies call.. What do you guys want to do?.. shall we go with a search or shall we look into crawling? I have no idea how but can look into it?

renniehaylock commented 8 years ago

Hey Sam... Fixed this one with a search box in my latest commit, I'll push it out soon... I tried out a bunch of different crawling libraries, but glassdoor is really smart about stopping crawlers, so I don't think crawling is an option... I tried selenium and a python library called scrapy...

SamirMarin commented 8 years ago

Nice man! yeah I think search box is a good option for now, we can always get the automatic fill in later as we start collecting data for ourselves!