Open stevieflow opened 9 years ago
There should be a Manage Datastore tab for users with the right permissions, with an option to import the data.
I believe this is manually run, so we may need to look at how this would happen as part of scheduled jobs.
On Wed, Mar 11, 2015 at 8:41 AM, Steven Flower notifications@github.com wrote:
Is there a config in DKAN to enable preview of CSV files, for example?
I note that the Trafford data does not have preview:
Over at DataGM (a CKAN), there is:
— Reply to this email directly or view it on GitHub https://github.com/ThreeSixtyGiving/data.threesixtygiving.org/issues/13.
w: http://www.timdavies.org.uk | m: 07834 856 303 | twitter: timdavies
Co-director of Practical Participation:
Practical Participation Ltd is a registered company in England and Wales -
Great, thanks @practicalparticipation . Apologies - some of these features are new to me
The Macc data doesnt seem to import, perhaps because it is a .xlsx / multisheet file:
http://data.threesixtygiving.org/dataset/macc-grants/resource/c3a30bff-f1b4-453c-bea7-0a88b5a5e966
How best to do that?
@stevieflow can the data be saved out to a basic CSV? Not sure DKAN would handle .xlsx...
@pmackay thanks. It has two worksheets as they have multiple admin geography codes (wards) for each grant. Saving an .xlsx as a csv will only flatten/save one of the sheets, wouldn't it?
So this is where DKAN will only be able to handle flat data, and we'll need a more advanced data store to ingest the JSON versions of files and provide better access to them.
That is something we should think about putting on the workplan as resources become available.
On Wed, Mar 11, 2015 at 1:47 PM, Steven Flower notifications@github.com wrote:
@pmackay https://github.com/pmackay thanks. It has two worksheets as they have multiple admin geography codes (wards) for each grant. Saving an .xlsx as a csv will only flatten/save one of the sheets, wouldn't it?
— Reply to this email directly or view it on GitHub https://github.com/ThreeSixtyGiving/data.threesixtygiving.org/issues/13#issuecomment-78265424 .
w: http://www.timdavies.org.uk | m: 07834 856 303 | twitter: timdavies
Co-director of Practical Participation:
Practical Participation Ltd is a registered company in England and Wales -
Yes only way with DKAN would be to save to 2 CSV files and import those. For the purpose of data indexing, etc is that worth doing, or more effort than its worth?
Hmm - struggled to generate a preview on the two latest datasets:
I tried the Manage Datastore > Import option with both csv files
They appear to be available via the Datastore API:
So the import worked, but for some reason they are not displaying in the previewer. Not sure why...
On Mon, Mar 16, 2015 at 11:25 AM, Steven Flower notifications@github.com wrote:
Hmm - struggled to generate a preview on the two latest datasets:
I tried the Manage Datastore > Import option with both csv files
— Reply to this email directly or view it on GitHub https://github.com/ThreeSixtyGiving/data.threesixtygiving.org/issues/13#issuecomment-81589741 .
w: http://www.timdavies.org.uk | m: 07834 856 303 | twitter: timdavies
Co-director of Practical Participation:
Practical Participation Ltd is a registered company in England and Wales -
Is there a config in DKAN to enable preview of CSV files, for example?
I note that the Trafford data does not have preview:
http://data.threesixtygiving.org/dataset/grants-voluntary-and-community-organisations/resource/7dfe26ac-4afd-4957-96b7-a2fa9651f61f
Over at DataGM (a CKAN), there is:
http://datagm.org.uk/dataset/transparency-code-trafford/resource/2927896b-0f07-475a-8ce4-5366b38a4ae2