search

dcsil / dream-team

Team repository for Dream Team
https://dreamtune-cdf8a.web.app/auth/login
0 stars 0 forks source link

Testing BBB scraper #204

Closed ribhav99 closed 4 years ago

ribhav99 commented 4 years ago

I have refactored the whole of the file to use promises instead. Iterated over it a bunch and now I'm not sure if there is no output because there is a bug or because of my internet speed. So gotta hop on a call with one of you to test this out.

RyanMarten commented 4 years ago

Testing this now

RyanMarten commented 4 years ago

It looks broken to me. here is what I am getting:

i functions: Beginning execution of "scrapeBBB"

[]

for the logs in the emulation

and

[]

for the html in http://localhost:5001/dreamtune-cdf8a/us-central1/scrapeBBB

jollyredflames commented 4 years ago

Tried it again still broken. Am trying to fix it. Message me before making changes to the file

jollyredflames commented 4 years ago

Fixed BBB scraper. But execution time is too long. Will need to make this a dedicated. run (once every x hours) and save results to local server to cut down latency

ribhav99 commented 4 years ago

Nope it's not working correctly. That's not the output we want.

I'm editing it rn to make the output fine and remove redundancies.

ribhav99 commented 4 years ago

I'll fix it in a couple hours. Working on 343 rn

ribhav99 commented 4 years ago

works perfectly. The html elements might change so if that happens we only need to change the scrapeBBBjs variable that's passed into cheerio $('.')