search

fbranda / Ukraine-and-Russia-Conflict

Other
0 stars 0 forks source link

How are datasets generated? #1

Open avivace opened 2 years ago

avivace commented 2 years ago

Hi @fbranda !

We (@emergenzeHack) received this repository and we'd like to add it as a Data Source. I get that the sources are mentioned in the README but it doesn't look like the process of extracting the data from the PDF and generating the CSV is reproducible (or even documented) at all.

Would it be possible to publish the code under an OSS license?

I'm of course available if you need help or any further clarification.

Thanks!

vi-enne commented 2 years ago

In case it could be useful, I developed a scraper in R language that extract the information form Viminale's Twitter account (it appears that Viminale's website is not accessible from R).

Here it is https://github.com/vi-enne/profughiUcraina

EDIT: thanks to @dennisangemi, we now have a dedicated repository with automatic updates.