Getting started

[pwalsh]

Description

This issue documents the initial steps to get started with a new Frictionless Data implementation.

Tasks

• [ ] Travis configuration
• [ ] Coveralls configuration
• [ ] Basic setup of README with badges
• [ ] Basic setup of license
• [ ] Review the whole family of specifications
• [ ] Review the implementation notes
• [ ] Review either the Python (Data Package Table Schema) or JavaScript (Data Package Table Schema) reference implementations (whichever language you feel most comfortable reading)
  • [ ] Note that we have high nineties test coverage on these libraries. Similar test coverage is expected here
• [ ] Review the stack reference
• [ ] Review the blog post that announces v1 of the specifications
• [ ] Review the test packages that can be used to test your work (in addition to the normal and expected unit tests)
• [ ] Review the OKFN Coding Standards
  • Parts of the coding standard are language specific, and parts are workflow specific. The workflow points are important for you. If you want to contribute language-related standards to our docs for your language, we welcome it!
• [ ] Write a set of high-level issues for each library, on the respective issue tracker, that outline the work plan
  • Note the structure of this issue: A narrative description and a specific list of tasks. Follow a similar pattern
  • The sequence of work is important: start with the Table Schema library first, as the Data Package library has a direct dependency on it
• [ ] Note the communication protocol for this work: All communication around the implementation must be in public. We want our work dynamic here to serve as an example for other implementors, and to share as much information as possible. There are two channels of communication:
  • GitHub Issues on tableschema-{LANG} and datapackage-{LANG}
  • Gitter chat at https://gitter.im/frictionlessdata/chat where all the core team at OKI are available for assistance
• [ ] Note the staff from OKI who are here to support you:
  • Jo Barratt - Project Manager for Frictionless Data
  • Evgeny Karev - Tech Lead for core Frictionless Data libraries
  • Serah Rono - Developer Advocate at Open Knowledge International, Dissemination Lead for the Tool Fund
  • Dan Fowler - Developer Advocate at Open Knowledge International, Pilot Lead for Frictionless Data, OKI Labs Lead
  • Adam Kariv - Engineering Lead at Open Knowledge International, Tech Lead on OpenSpending
  • Paul Walsh - Chief Product Officer at Open Knowledge International
• Any communication around the grant agreement should be directly done by email with Jo Barratt, Frictionless Data Project Manager

[roll]

Some implementation notes:

• The implementation reference provides public API information. For this package the high-level public API is Package/Resource/Profile/validate.
• I suppose Julia is a very similar to Python so in the most cases just strait porting of https://github.com/frictionlessdata/datapackage-py should work (with some exception i.e. see below)
• reference implementations of Profile class - https://github.com/frictionlessdata/datapackage-js/blob/master/src/profile.js - it's very simple class. A Python version has some old code not really fully used so it's much more verbose.

[loleg]

Thanks @roll @pwalsh for this, really helps to have wayposts.

[s-celles]

Hello,

to create a sample Julia project you should use PkgDev

Pkg.add("PkgDev")
using PkgDev
PkgDev.generate("DataPackages", "MIT")

This sample project will be generated and you will have sample unit tests. Badges for Travis, coverage... in README.md

Kind regards

[s-celles]

You should notice that most Julia packages use plural in their name and their Github repository url finish using .jl (not -jl). Julia users like package name with CamelCase

[roll]

@scls19fr Thanks!

Related to the repo naming - it's because of the Github org standard.

[s-celles]

https://github.com/davidanthoff/IterableTables.jl from @davidanthoff and https://github.com/JuliaData/DataStreams.jl from @quinnj are probably related projects to consider

[loleg]

Thanks very much for pointing it out @scls19fr ~ glad to have someone new watching this project :-) Also, I have added your links to a Related Projects page on the wiki: https://github.com/frictionlessdata/datapackage-jl/wiki/Related-projects

[s-celles]

Some other projects that may be related to DataPackage.jl and could be add to wiki

Queryverse https://github.com/davidanthoff/Queryverse.jl

And for downloading / caching data https://github.com/oxinabox/DataDeps.jl https://github.com/helgee/RemoteFiles.jl https://github.com/JuliaPackaging/BinaryProvider.jl

[oxinabox]

At some point we should talk. Will you be at juliacon?

[s-celles]

Unfortunately I won't be there

[roll]

@loleg I'm closing meta issue as this stage is far behind us. Let's just use individual issues for everything left/reported/etc