[Proposal] Open Data XLS | PDF to JSON

[pasindud]

Please comment on your thoughts

[dhammikamare]

How about XLS|PDF to JSON. Since SQL itself has lots of limitations now a days specially in mobile and client side of web. I think it'll be great if we can have JSON data as there are ways to convert JSON to SQL if someone wants. Then even by a simple request you can have the data tunnel to apps that you build.

[pasindud]

Hi @dhammika-marasinghe
Yea that is a great idea actually. I shall change the topic.

Change

• Open Data XLS | PDF to SQL -> Open Data XLS | PDF to JSON

[dhammikamare]

:+1:

[pasindud]

@dhammika-marasinghe There about 80 data sets suggestion on where to start ?

[dhammikamare]

seems like Central bank, Motor Traffic, ICTA and Police has more useful information for the developers

[pasindud]

Can you list down set of data sets ??

[dshgna]

I think this is a great idea! What about starting with datasets under Population: population, literacy rate and colombo consumer price index? I think they would be among the most useful.

[pasindud]

@dshgna Great !

We can start from here Link

1. Annual Colombo Consumers Price Index
2. Annual Population Growth rate
3. Education expenditure
4. Population 2012
5. Departures for Foreign Employment by Manpower Level 1994 - 2012

[pasindud]

Guys are you guys working on this?

[dhammikamare]

hoping to start my work after 2 weeks finishing all these conferences, projects, exams, ... :p

On Thu, Dec 4, 2014 at 11:59 AM, Pasindu De Silva notifications@github.com wrote:

Guys are you guys working on this?

— Reply to this email directly or view it on GitHub https://github.com/CodeLanka/codeLanka-Proposals/issues/2#issuecomment-65543474 .

Dhammika Marasinghe Computer Engineering Undergraduate, Department of Computer Engineering, University of Peradeniya​

Mobile | +940770776737 LinkedIn | dhammikamarasinghe http://lk.linkedin.com/in/dhammikamarasinghe/ Facebook | dhammika.marasinghe.net https://www.facebook.com/dhammika.marasinghe.net Google+ | DhammikaBandaraMarasinghe http://google.com/+DhammikaBandaraMarasinghe

[dshgna]

I'll be starting after Dec 12th. Got final year project.

[pasindud]

bump

[pasindud]

Guys made a translisteration singlish api download and have a look https://github.com/CodeLanka/singlish-api

[hliyan]

brilliant! i'll check this out as soon as i can. btw, is this the right issue for this comment?

[pasindud]

oh it seems not

[pasindud]

@dshgna bump

[pasindud]

Check these guys

Annual Population Growth rate

http://codelanka.github.io/open-data-visualization/visualization/annual_population_growth_rate

Dataset to JSON - https://github.com/CodeLanka/open-data-api

*dataset has missing metadata

[agentmilindu]

We can get datasets from Health Ministry also ( Specially about disaster management, etc. ), I can help with that.

[pubudu91]

Hi.. Since we are still in the very early stages of this, wouldn't it better to plan this project with a focus on where web technologies are headed? My suggestion is to use the linked data approach, using RDF.

Check this: http://www.w3.org/TR/ld-bp/

(I'm also new to these so don't really have much of an idea about the scale of doing such a project though)

[pasindud]

@pubudu91 do you know a sample which adheres to this so we can check it?

[pasindud]

http://opendatahandbook.org/ something to look into

[pasindud]

I would more like to get the data to JSON so later when we have to adhere to standards we can run scripts to transform them.

[pubudu91]

@pasindud http://www.w3.org/wiki/TaskForces/CommunityProjects/LinkingOpenData/DataSets < try this one

[ishan-marikar]

It would also be useful/interesting to get data-sets from the department of transportation. I haven't been able to find any, but I'll try contacting them (hopefully I won't be turned down). Also, I'll look into converting the data-sets already provided into JSON. (Sorry if my comment seems out of place, I'm new here ._. )

[hliyan]

has anyone seen this initiative: http://dev.socrata.com/ ?

edit: it's a commercial company, but i think there's something to be learned from their approach

[ishan-marikar]

@hliyan That's exactly what I wanted to accomplish. This is worth a look too. www.youtube.com/watch?v=RrPZza_vZ3w It's rather long though.

[ishan-marikar]

Apologies for my absence. Was overwhelmed with work, so I couldn't really contribute much to the projects recently, but I've been coding a couple of Python scripts that would let me efficiently convert the data-set's from gov.lk to a more computer readable format. I'll keep you updated.