jdorfman / awesome-json-datasets

A curated list of awesome JSON datasets that don't require authentication.
Creative Commons Zero v1.0 Universal
3.33k stars 376 forks source link

Make awesome-json-datasets an awesome JSON dataset #186

Closed dvdsgl closed 6 years ago

dvdsgl commented 6 years ago

One thing I'm doing for #185 is specifying these datasets as a JSON dataset. It would be a good idea to make this awesome list of JSON datasets an awesome JSON dataset itself, rather than just a Markdown list.

A normalized JSON dataset with metadata and endpoints for all of the listed datasets would be even more awesome and so meta! 😆

jdorfman commented 6 years ago

This is actually a great idea. I like how recursive it is. How would you automate it? A probot that creates a PR with the JSON would be ideal.

dvdsgl commented 6 years ago

The simplest approach would be to have a single data.json at the top-level that contains the data for each dataset, then simple a shell script or Python program that generates your README.md.

First we'd have to decide on a schema for that JSON file. Maybe something that looks like:

{
  "datasets": [
    {
      "name": "Open Notify Space Data",
      "category": ["Science", "Space"],
      "endpoints": [
        { "name": "ISSPosition", "url": "https://.../api" }
      ]
    },
  ]
}
jdorfman commented 6 years ago

@dvdsgl I'm not opposed. Shell would be ideal since it is easier for most to get started (plus a great excuse to use SHML)

Let me think about it. My main concern is alienating folks that just want to make a quick edit to the markdown file.

Edit: It would have to be reversed, i.e. Markdown to JSON

stale[bot] commented 6 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.