search

bcgov / ckanext-bcgov

BC Data Catalogue source code, main ckan extension
http://catalogue.data.gov.bc.ca
GNU Affero General Public License v3.0
24 stars 23 forks source link

Add support for Frictionless Table that defines resource-level data dictionary #407

Open jeff-at-h3 opened 6 years ago

jeff-at-h3 commented 6 years ago

Proposed implementation (by Leo):

  1. Data provider submits data pkg as frictionless specs to git repo (GOGS)
  2. DataBC accepts git pull request (QA), webhook imports into Catalogue
  3. Catalogue viewer extension provides friendly view of the package (like API specs console integration)

The frictionless package needs to be accessible to consumers (so git vs. gogs?)

jeff-at-h3 commented 6 years ago

CN> Alternate approach to consider is loading frictionless package as new record resource.

Possibility of accepting packages (JSON) to drive the frictionless table To determine fields when we receive a non-structured file (txt) Feeds into security design to pre-process data into frictionless tables

Next Steps: 1.Jared to do initial research to see what’s available in the CKAN community

  1. How do we implement it - analysis
  2. how do you make it look good?