Investigate topic modelling

mood-mapping-muppets / repo

COVID-19 European news text analysis dashboard for the Embeddia hackathon

http://covidmoodmap.rahtiapp.fi/

Apache License 2.0

0 stars 1 forks source link

Investigate topic modelling #7

Open frankier opened 3 years ago

frankier commented 3 years ago

There are a few things that can be done here, but as well as potentially finding multilingual topic clusters, another related issue is whether the story is mainly about covid or just mentions it. e.g. if there are covid keywords in the headline or lede then probably it is, otherwise maybe it's just mentioned in relation to something else (XXX elected president... blah blah.. they'll have a lot on their plate including covid...)

frankier commented 3 years ago

Might want to take a look also at Embeddia's tools https://github.com/ezosa/cross-lingual-linking https://github.com/sfermoy/TeMoCo and https://github.com/SkBlaz/rakun seem relevant

djinn-anthrope commented 3 years ago

I like the ideas you have proposed for the task at hand. I plan to approach it as follow:

[x] Look into the Hackathon tools first for anything associated with topic modeling
[ ] Perform basic LDA on just English data, and cluster to find shared domain information (I can speak only English so I am analyzing the efficacy of the baseline model using that)
[ ] Introduce cross lingual linking and isolate related articles in different languages based on their topics