search

BlackbitDigitalCommerce / pimcore-data-director

Import Bundle for Pimcore
16 stars 3 forks source link

Import not processed #54

Open betterapp opened 1 year ago

betterapp commented 1 year ago

On one off my dataport I see in logs something like this.

image

When I cancel this import it is back in a while but it is not processed.

Settings: image

DD: 3.2.5

BlackbitDevs commented 1 year ago

Can you have a look in the plugin_pim_queue table to check which command is queued / tried to be executed?

betterapp commented 1 year ago

under plugin_pim_queue I got:

image

betterapp commented 1 year ago

Is it possible that something wrong with update from 3.1.17 to 3.2.5 ? Maybe we should remove DD and install it again ? Is there better way then export dataports and import them manually ? Or maybe I do not need to remove those tables ? image

If I will not remove them and remove the rest tables and reinstall DataDirector will it work ?

Or maybe I can rollback to 3.1.17 ? Will it work ?

betterapp commented 1 year ago

I rollback composer package on my local dev to 3.1.17 and my dataport works ok. There is something wrong with it on 3.2.5 Do You testing DD before releases ?

BlackbitDevs commented 1 year ago

If something does not work, it would also not work if you execute the queued command manually on CLI. Please do that with -vv option and see if it outputs any errors.

Reinstalling will not solve any problems.

betterapp commented 1 year ago

[NOTICE] E_USER_NOTICE: E_NOTICE "Undefined index: __source" in callback function for field "Result callback function", line 81: 

$file = $params['rawItemData']['__source']['value']; <<<

but I have defined it under Raw data fields image

BlackbitDevs commented 1 year ago

Do you see __source column in Preview tab? Actually it should exist in Result callback function. Try $params['logger']->info(array_keys($params['rawItemData'])); and look in the log which fields this array contains.

betterapp commented 1 year ago

DD version: 3.1.17 and 3.2.5

We have a dataport that start run if someone upload xlsx file into specific location: image

The file is processed by dataport and in the end (on lastCall) it is moved here and custom log file is generated image

Here is the video that show what is happening. When I first upload the file into location it start working but then create additional queues every second with "__source" does not exist. This is because first run move this file from this location in callback function. When I upload the file again it is working ok.

Take a look on video: https://files.fm/u/wcjh97duj

It worked fine in older versions 3.0.X