eileenmcnaughton / nz.co.fuzion.csvimport

Import to API using csv GUI
GNU Affero General Public License v3.0
8 stars 27 forks source link

Progress bar and silent failures? #31

Closed Stoob closed 2 years ago

Stoob commented 4 years ago

Initially I thought it was an External Identifier problem, but I'm noticing some confusing behavior whereby the progress bar progresses (or doesn't) irrespective of the progress bar or entity ID number changing or not. For example, some rows may be failing on a mismatch or duplicate, but I couldn't tell. The progress bar proceeds anyway. In the end, there no error report generated. Maybe just an explanation would help. I could help write some documentation.

Stoob commented 4 years ago

Let me offer some screenshots and specific examples. I'm attempting to import 400 relationships with the API extension because I hope to import relationship dates. Turns out, when I use the CiviCRM native importer I had 4 mismatched contact types (Org/Ind). The import completes and gives me the file attached.

But using the API importer the entity (3) is stalled out yet the progress bar is continuing after 2 minutes. And at the 15 minute mark the progress bar stalls out entirely.

In some cases, no relationships are created at all. In other cases relationships are created up until the entity/row number (3, 61, 379, etc) at which the number stalls but the progress bar keeps going. Typical reasons might be: contact mismatch, duplicate rows, or self-referential relationship IDs

im 15min 2min

bph commented 4 years ago

I had a similar experience of an import progress stalling after 32 - on a csv file with 400. CiviCRM log doesn't have any additional information.

Stoob commented 2 years ago

This no longer seems to be an issue, or at least we are able to skip past the apparent error with the arrow button - has it been fixed @eileenmcnaughton ?

eileenmcnaughton commented 2 years ago

hmm if it hasn't been hit in a year then maybe it has