search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.23k stars 21.39k forks source link

Overwrite mode in the sink (a lakehouse table dataset using the microsoft fabric lakehouse connector) options of a copy activity throws an error #120793

Closed DriesVyvey closed 6 months ago

DriesVyvey commented 6 months ago

In ADF, I am using a copy activity for writing oracle data to a table in a lakehouse within microsoft fabric. The option 'append' works perfectly fine, but when I try to user the option 'overwrite' then I get an error.

This is the error message: ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property '' is invalid: 'De aangevraagde waarde OverwriteSchema is niet gevonden.'.,Source=,''Type=System.ArgumentException,Message=De aangevraagde waarde OverwriteSchema is niet gevonden.,Source=mscorlib,'

The dutch text 'De aangevraagde waarde OverwriteSchema is niet gevonden.' is as follows in English: 'The requested value OverwriteSchema has not been found'

regards, Dries

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ManoharLakkoju-MSFT commented 6 months ago

@DriesVyvey Thanks for your feedback! We will investigate and update as appropriate.

Naveenommi-MSFT commented 6 months ago

Hi @DriesVyvey The error message you provided indicates that the value of the property 'OverwriteSchema' is not found. This suggests that there may be an issue with the configuration of the copy activity.

To troubleshoot this issue, you can try the following steps:

  1. Check the configuration of the copy activity to ensure that the 'OverwriteSchema' property is set correctly. Make sure that the property is spelled correctly and that the value is valid.

  2. Verify that the schema of the target table in the lakehouse matches the schema of the source data. If the schemas do not match, you may encounter errors when using the 'overwrite' option.

  3. Check the permissions of the account used to write data to the lakehouse. Make sure that the account has the necessary permissions to overwrite data in the target table.

If none of these steps resolve the issue, I'd recommend working closer with our support team via an Azure support request.

Naveenommi-MSFT commented 6 months ago

@DriesVyvey We are going to close this thread, if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.

Please-close