search

UkraineNow-Intel / autoSA-backend

Django backend for autoSA
0 stars 1 forks source link

Examine possibilities to mine Website Data #7

Open mgavish opened 2 years ago

mgavish commented 2 years ago

On the internal source list, we have other possibly interesting sources that would be interesting to show in our NLP pipeline, e.g. UK-gov sites, news sources etc…

Like the Twitter API, it would be good to write a crawler to access these source to then use them for the information dashboard

j-bennet commented 2 years ago

According to the conversation in Signal today, this is deprioritized, Twitter and Telegram are top priority.

See the MVP brief (link in Signal) for more info.