AtlasOfLivingAustralia / spatial-hub

New spatial portal front end using AngularJS
https://spatial.ala.org.au/
7 stars 16 forks source link

Unable to import points from CSV by any method #445

Closed kylie-m closed 1 year ago

kylie-m commented 1 year ago

No longer able to import points using a CSV file, which previously worked.

Trying to upload a CSV file, the following error message appears: “There are errors in the dataset that needs to be fixed before you can upload.”

It is possible to upload points using the paste CSV function, either from Spatial or starting from ALA Sandbox and moving across to SP.


update 25/11/22 I'm aware this is a deprecated feature now, but believe it was still meant to work using the 'paste CSV' function, and/or by using ALA Sandbox. I found that the upload stopped at 25% for all 4 methods.

Given that our users find this feature useful in their work, could we please aim to fix so that at least one of the methods to import points from CSV works?

Raised by user: https://support.ehelp.edu.au/a/tickets/156585

kylie-m commented 1 year ago

Raised by a second user: https://support.ehelp.edu.au/a/tickets/162977

timhicks-ala commented 1 year ago

Additionally raised in https://support.ehelp.edu.au/a/tickets/166570

timhicks-ala commented 1 year ago

Some investigation. It appears impossible to use the Import -> Points tool in Spatial, which means it's impossible to run AOO/EOO analysis on uploaded data. Neither uploading a file and pasting CSV data works as in both cases, the process fails at 25%.

failed at 25percent

Strangely, if you then try and run an AOO/EOO and "Use imported points", the failed uploads will appear in the list. Note that a test CSV with four records in it shows as having 5 occurrences - possibly it's counting the header row as a record here:

use imported points

In either case, the AOO/EOO fails, stating no occurrences were found in the defined area, despite the area having been left as the default World:

no occurrences found

If I attempt to paste just the four lines of CSV with records in them, ignoring the header row, it still fails, but at 50% instead of 25%, and the list of imported points shows an entry with 4 records in it:

failed at 50percent

So:

sat01a commented 1 year ago

Assigned to @adam-collins

adam-collins commented 1 year ago

SOLR was down. Also CSV import is working again for me in Chrome. Pasting data still works.

sat01a commented 1 year ago

Closing the issue. @adam-collins confirmed it works