search

f4bD3v / humanitas

A price prediction toolset for developing countries
BSD 3-Clause "New" or "Revised" License
17 stars 7 forks source link

Compile list sources on topics of commodity pricing and food security #12

Closed f4bD3v closed 10 years ago

f4bD3v commented 10 years ago

Compile a list of news websites, important blogs etc. that publish/post articles on food prices, international commodity markets and food security

halccw commented 10 years ago

[News] The Times of India. topic: "food prices" http://timesofindia.indiatimes.com/topic/food-prices

albu89 commented 10 years ago

i created a file under ressources/pdf/pricetheory..... please add the links you find in there

f4bD3v commented 10 years ago

Update: pls add all found resources to data/[country]/sources.txt for the respective country. We still need to find data sources for "food stocks (partly covered by agmarket), weather, Consumer Price Index (CPI) --> inflation, currency exchange rate (w.r.t $), crude oil price"

tonyo commented 10 years ago

A quick note about collecting weekly data from Indian Directorate of Economics and Statistics (http://rpms.dacnet.nic.in/). As some of you may now, there's a limit for processing jobs which turned out to be daily. I am usually able to download weekly data for approx year and a half before I hit the limit , so by the end of the week I hope to get everything they have. Getting daily prices from http://www.agmarknet.nic.in/: in progress.

tonyo commented 10 years ago

Things went better than expected and weekly prices from India (from rpms.dacnet.nic.in/) were successfully downloaded (see data/india/csv_weekly).

I also pulled rice daily prices from http://www.agmarknet.nic.in/ (data/india/csv_daily), met no connection restrictions with that.

If someone wants to download daily prices for some commodity, use download_agmarket_daily.py (in data_crunching/india_timeseries/agmarket.nic.in/) script (no args for a help message, usage is straightforward, I hope), or download_all_years.sh script to download the data for several years, setting a desired commodity and time frame in the script itself.