search

emorice / galp

Incremental distributed python runner
MIT License
0 stars 0 forks source link

Wrap deserialize errors in lookup errros #50

Open emorice opened 2 years ago

emorice commented 2 years ago

We had the task name included in deserialize errors. But the serializer should not care nor know what the name of the resource is.

Still, we want to have the name of the resource show up in the logs if a cache corruption happens. This should be added higher in the stack, consumers of the serializer API should catch the DeserializeError and wrap it in a contextual error that adds things the the resource name.

emorice commented 2 months ago

Still valid, if a worker fails to load a task input, the actual full hash is nowhere to be found. Does not happen that much though.