search

Etwas-Builders / Twitter-Source-Bot

Ever wanted to know the source of a tweet? Just @whosaidthis_bot and I'll tell you where it came from
https://twittersourcebot.tech/
15 stars 1 forks source link

Update to Puppeteer caused bad nlp #71

Closed CryogenicPlanet closed 4 years ago

CryogenicPlanet commented 4 years ago

https://twitter.com/whosaidthis_bot/status/1261061520991170560

image

NLP Output: http://34.71.148.202:3000/nlpOutput?tweetId=1259940980142243841

@rithvikmahin Something weird was happening I don't know how that previous page was getting cited but anyways by making puppeteer more stealh that pages finishes later cause it doesn't instantly respond and it causes this bad nlp.

CryogenicPlanet commented 4 years ago

image

rithvikmahin commented 4 years ago

Fixed by updating the overall threshold to 0.45, and tweaking the whitelist threshold increase to 0.1.