Scraping content

[afinika]

help post most updated content related to questions

• Border regulations for Ukrainian refugees, immediate border
• How to apply for asylum and who is offering it
• Latest government announcements green lines, where food, shelter, medical help

TODO

• [ ] Identify OFICIAL and credible sources
• [ ] finalize what content we need to scrape
• [ ] define the implementation tasks

[ursueugen]

Working on sources: https://docs.google.com/document/d/18HDUtf0eUi5f8j-t7N5gLOftoFqK_F-jk_txDEegZio/edit?usp=sharing

Important sources: (1) Telegram channel Prima sursa appears to be the most dynamic official source, but not all notifications are translated to RU -> could extract and translate to RU (2) Web platform UARefugees presents all kind of non-gov support, including shelter and transport.

Comments by questions of interest:

(1) Borders

• Sources: Prima sursa (telegram), customs and border police websites => It appears these sources cover redundantly and comprehensively the topic.
• Action point (AP): Extract notifications from the 3 sources and translate to RU (often required)

(2) Asylum

• Sources: Prima sursa, Biroul Migratie si Azil, (Non-gov) UARefugees platform => For governmental asylum, I couldn't readily identify shelters - I think this info runs in a closed loop, refugees are directed (a) at customs and (b) by calling to the green line. The primary source for this kind of info appears to be "Biroul Migratie si Azil". On the other hand, there has been amazing effort by UARefugees platform for presenting shelters (and other kind of support) from civilians.
• Action point (AP): Extract updates from Biroul Migratie si Azil and present stats from UARefugees platform.

(3) Gov announcements Prima sursa appears to be the primary channel for gov announcements. AP: already covered.

What do you think? @afinika

[afinika]

@ursueugen Ok so in chats we have 3 questions that are asked more often

1. Shelter now! Safe!
2. Where and how to cross the border? I don/t have documents what do I do? How long do I need to wait?
3. What countries offer asylum for Ukrainians and how to apply for them, where, what documents what process?

we solved shelter manually for Moldova and Romania, there are more openings, is hard to track manually what we already have and what not. The focus is on gov shelters because are safer and those cannot say no. In other countries, I did not find the gov shelter location, places, and phone numbers only private, maybe hotels.

Now the focus is crossing the border problem.

Let's focus on migration info here #18 is the ref of the implementation please coordinate the content scraping with @Nikro

[Nikro]

@ursueugen - Hey, any progress on those 2 sources?

I did a sample output - https://docs.google.com/spreadsheets/d/17xGhHoFh6oN3vMaAGTsve6mb69cL0PlchzF2nfzXr1c/edit?usp=sharing - we will use same thing for bulk imports.

We'll also need to massage the data to fit these criteria (i.e. sanitize the name so we have only first name, or remove the numbers from street addresses).

As we're crawling potentially sensitive data and we don't want that to fall in wrong hands, I've created a new repo where I invited our dev-team (private one).

[Nikro]

@mdiannna - welcome!

You can use same sample output from above, but as source: https://www.shelter4ua.com/ua

I will send you in private the JSON I found, we'll probably only need to massage the data and export it to CSV.