Generate FIDIL JSON

[kyao]

FIDIL organizes dataset at the timeseries level. Assume each FIDIL timeseries can be uniquely specified by the triple (dataset_id, variable_id, country). For the purpose of Causx, except for the time qualifier, ignore qualifiers. Each uploaded Excel/CSV file can generate one or more timeseries.

FIDIL JSON is an array of timeseries objects, each timeseries object has properties

• id: string, uuid md5 hash of concat(dataset_id, variable_id, country)
• country: string, country label
• country_cameo: string, URI for country
• label: string, variable (property) label
• description: string, concat(document description, variable (property) description)
• excelFile: array of strings, where each string is the name of an uploaded file
• sheet: array of strings, where each string is the name of a sheet. If the uploaded file is CSV, then use the CSV filename without the suffix.
• units: string
• structuredDataMapping, object with properties
  • docID, string
  • factorClass, string
  • normalizer, string
  • relevance, number
  • other-user-defined-keys, string
• structuredData, array of objects, each object with properties
  • timestamp, string in ISO format
  • value, number

[devowit]

excelFile: array of strings, where each string is the name of an uploaded file sheet: array of strings, where each string is the name of a sheet. If the uploaded file is CSV, then use the CSV filename without the suffix.

in a case with N excel files with M sheets, sheet contains MxN values?

[devowit]

other-user-defined-keys, string

this is a single key whose string value is concatted from multiple keys, or a filler entry for any other user keys, ie

structuredDataMapping, object with properties docID: string factorClass: string normalizer: string relevance:number mykey1: string mykeyt2: string2

[devowit]

attached is an example FIDIL json (from the freedom house press example)

please look at it and let me know if I've built it correctly. Thanks @kyao

example_fidil_freedomhousepress.txt

[kyao]

The file looks good to me. I am sending it to the CX folks to have them take a look.

[kyao]

One thing is all the factor classes should have the prefix: http://ontology.causeex.com/ontology/odps/ICM#

[devowit]

ok, i have pushed the necessary change to add the prefix