search

application-research / delta-importer

Import client for Delta
2 stars 1 forks source link

feat: support multiple address per dataset #20

Closed jcace closed 1 year ago

jcace commented 1 year ago

closes #19

Note: This change is not backwards compatible with the old version of the datasets.json file.

You must enclose the address field in square brackets to make it a list, ex:

OLD datasets.json

[
  {
    "dataset": "radiant-ml",
    "address": "f1p3l3wgnfukemmaupqecwcoqp7fcgjcqgqcq7rja",
    "dir": "/mnt/delta-datasets/radiant-poc",
    "ignore": false
  }
]

UPDATED datasets.json

[
  {
    "dataset": "radiant-ml",
    "address": ["f1p3l3wgnfukemmaupqecwcoqp7fcgjcqgqcq7rja"], // <- wrap in [ ]
    "dir": "/mnt/delta-datasets/radiant-poc",
    "ignore": false
  }
]