search

AzureCosmosDB / data-migration-desktop-tool

MIT License
122 stars 46 forks source link

TableStorage to Parquet-AzureBlob doesn't work #101

Open GuillaumeVadeBe opened 9 months ago

GuillaumeVadeBe commented 9 months ago

Migrating TableEntities from TableStorage to Parquet is not working. An exception is thrown when the DataField is created, stating that DateTimeOffset is not supported.

image

However, the only DateTimeOffset in the TableEntities that we are trying to migrate is the timestamp (a default value in a TableEntity), see Table Entity Class. So that would mean that this functionality can't work at all.

Are there any plans to fix this?

crpietschmann commented 6 months ago

This exception (System.NotSupportedException: DateTimeOffset support was dropped due to numerous ambiguity issues, please use DateTime from now on.) is being thrown by the Parquet.Net nuget package.

Here's the line in Parquet.Net that's throwing the exception: https://github.com/aloneguid/parquet-dotnet/blob/d8febde144ae4f2424947caa90a625c4c9d7ab49/src/Parquet/Schema/DataField.cs#L67

It looks like to fix this, a work around will need to be figured out.