search

Bertverbeek4PS / bc2adls

Exporting data from Dynamics 365 Business Central to Azure data lake storage or MS Fabric lakehouse
MIT License
60 stars 22 forks source link

Error: Collection was modified; enumeration operation may not execute #25

Closed Sr1983 closed 11 months ago

Sr1983 commented 1 year ago

Hi, we have encountered the error "Collection was modified; enumeration operation may not execute" during the last 2 day (never happened till now).

The error is related to the Synapse Pipeline "Consolidation_OneEntity", activity "Switch - Copy Staging to data - Copy Parquet".

In previous github repository was reported the same error yesterday: https://github.com/microsoft/bc2adls/issues/138

Have you got any idea to solve the issue? It happen randomly on different entity (apparently without a logic).

Bertverbeek4PS commented 1 year ago

Is there maybe data that is deleted?

Sr1983 commented 1 year ago

Hi thank you for yuor answer; we don't have any evidence about data deleted. It's really strange because we are using the pipeline from 3 month and this issue never happened. In the other post, the user says the he solved, removing the entity and adding it again. Is it possible?

Bertverbeek4PS commented 1 year ago

In pull request: https://github.com/Bertverbeek4PS/bc2adls/pull/14 There is a change of paritioning in the dataflow. If you import that change and run it again.