Integration with Data.gov

opendataphilly / Open-Data-Catalog

Open Data Catalog is an open data catalog based on Django, Python and PostgreSQL. It was originally developed for OpenDataPhilly.org, a portal that provides access to open data sets, applications, and APIs related to the Philadelphia region. The Open Data Catalog is a generalized version of the original source code with a simple skin. It is intended to display information and links to publicly available data in an easily searchable format. The code also includes options for data owners to submit data for consideration and for registered public users to nominate a type of data they would like to see openly available to the public.

http://www.opendataphilly.org/

MIT License

244 stars 90 forks source link

Integration with Data.gov #31

Closed mheadd closed 4 months ago

mheadd commented 10 years ago

It appears that the stewards of Data.gov have set up ways for city data portals to integrate and have their data sets listed in the Cities community.

http://project-open-data.github.io/catalog/

In essence, integration involves generating a compliant data.json that lives at the root URL of participating sites. It would be awesome if there was a way to generate a data.json file for ODC sites.

tomkralidis commented 10 years ago

@mheadd FYI ODC is built with pycsw for CSW search/discovery/federation. It might be easier to put this functionality in pycsw, which ODC then leverages as a result. This would then make both ODC and non-ODC pycsw deployments data.gov friendly, encouraging even more integration.

Thoughts?

cc @jj0hns0n FYI

andrewbt commented 10 years ago

What a coincidence! I just met and spoke to @JeanneHolm from Data.gov this evening about these very plans of theirs.

mheadd commented 10 years ago

@andrewbt - I've spoken with @JeanneHolm about this in the past in general terms. Not sure there was ever a specific document before now that listed exactly how to do this.

@tomkralidis I'm not a Python dude, so I'll defer to you (and others) on your suggested approach. I just think this would make the ODC platform much more powerful, allowing users to integrate with the largest data repository on the country. Let's do this!

JeanneHolm commented 10 years ago

There are a few options and open to what works best. Cities connect to http://Cities.Data.gov via federation, JSON, technologies like CKAN, Socrata or Junar, or even CSV files. How can we make it work with ODC too? Agreed on "let's do this!".

waldoj commented 10 years ago

The U.S. Department of Health and Human Services has created a data.json plugin for CKAN, which they provide on their GitHub repository. I mention that because portions of that program might be useful to provide similar functionality within ODC.

mheadd commented 10 years ago

Agreed. It would be great to see a similar plug in for ODC. Something that generates a compliant data.json file.

@JeanneHolm - if such a plugin is built, and used by ODC site operators, what is the process for getting integrated with Data.gov? I assume the URL to the new data.json file needs to be added somewhere. Is there a process or point of contact for this?

JeanneHolm commented 10 years ago

We are working on expanding the options for cities to make their data accessible through Cities.Data.gov with the migration to our new interface (see http://Next.Data.gov). We could embed the option for ODC (and the others) prominently on the new site, but we could work on the plug-in now and integrate OpenPhilly today.

tomkralidis commented 10 years ago

FYI a first pass is now implemented in master (2c9e5337dcebf144466028dce25618df52cf36d2).

waldoj commented 10 years ago

Huh, apparently GitHub's mobile site doesn't parse emoji. :-/ Anyhow, yay!

andrewbt commented 10 years ago

That's cool! Thanks Tom!

On Mon, Jan 13, 2014 at 9:25 AM, Waldo Jaquith notifications@github.comwrote:

Huh, apparently GitHub's mobile site doesn't parse emoji. :-/ Anyhow, yay!

— Reply to this email directly or view it on GitHubhttps://github.com/azavea/Open-Data-Catalog/issues/31#issuecomment-32173003 .

Andrew Thompson, Community Evangelist

Join our community! Google Groups: Cicero API http://www.azavea.com/products/cicero/community/user-community/| OpenTreeMaphttps://groups.google.com/forum/?fromgroups#!forum/opentreemap-user| GeoTrellishttps://groups.google.com/forum/?fromgroups#!forum/geotrellis-user| OpenDataCataloghttps://groups.google.com/forum/?fromgroups#!forum/opendatacatalog-user

rcheetham commented 4 months ago

We are archiving this repo as no active work is being done or expected.