search

fandangOrg / fandango

FAke News discovery and propagation from big Data ANalysis and artificial intelliGence Operations
1 stars 1 forks source link

Forward of field "keywords" #90

Closed pstalidis closed 3 years ago

pstalidis commented 3 years ago

In order to improve the quality of topic keywords (#86), we should also consider the keywords extracted by the crawlers. These exist in the "keywords" field of the raw_article.

Preprocessing is ignoring this field but now we need this forwarded to the analysers.

@dmgutierrez please edit the preprocessor to forward this field. @macagari this will affect also the output that you get in the online process.

dmgutierrez commented 3 years ago

I'm working on it. I will include a new version of the preprocessing on Monday with the keywords fields on it.

dmgutierrez commented 3 years ago

@pstalidis @mmagaldi-eng @macagari I have updated the preprocessing to have the keywords. Once we test it, I will close the issue.