search

Bertverbeek4PS / bc2adls

Exporting data from Dynamics 365 Business Central to Azure data lake storage or MS Fabric lakehouse
MIT License
49 stars 20 forks source link

missing event when the job queue ends. #119

Closed willgart closed 5 months ago

willgart commented 5 months ago

Hi,

I'm testing the events related to the bc2adsl tool. the export is finished event is fine, but raised for every table which has been exported and which contains data and not 1 time when the job queue (or the export action) is done. which is confusing because the event is not telling me which table has been exported and my power automate is triggered multiple times.

so there is a missing event, a real "Export terminated" raised 1 time after the export process (not by table) and which should contains the total number of rows exported; or the number of tables which contains exported data.

this will allow us to run a power automate (for example) and start the Fabric job, but only 1 time and only if data has been exported (or not; because no data exported may be a problem I want to identify when we are supposed to have changed data on a regular basis)

but else, crazy good job!!!

Bertverbeek4PS commented 5 months ago

Hi @willgart there is an event OnExportFinished. This is only triggered once when the export is finished. With that yo ucan start the notebook in Fabric.

willgart commented 5 months ago

if it's the event "Export is finished" , it's the one I'm using but it is raised for each table and only for the ones with data exported. (so with changes detected) here the events I'm seeing: image

image

I'm using BC23.22

Bertverbeek4PS commented 5 months ago

@willgart you are right! I have created a pull request for it. There is a new business event created which calls OnAllExportIsFinished = 'Export is finished of all tables'

That will go off when everything is done. Even in the Job queue.

Bertverbeek4PS commented 5 months ago

I have also pushed it to the releasebranches 24.23 and 23.22