jeppe742 / DeltaLakeReader

Read Delta tables without any Spark
Apache License 2.0
47 stars 14 forks source link

Update deltatable.py_Error Handling added to _apply_partial_logs function #57

Open crisnaX opened 6 months ago

crisnaX commented 6 months ago

Error Handling added to _apply_partial_logs function to handle schemaString error due to imperfection in delta logs.

While I am trying to load my delta table, I am facing key error. This error occured due to imperfections in delta logs as it can not find schemaString in one of the checkpoint in my delta logs. Due to this error DeltaTable is not able to load records. Using this error handling I am able to skip the problematic record and able to load the new records. IMG_20240309_031808