delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python

https://delta-io.github.io/delta-rs/

Apache License 2.0

2.33k stars 411 forks source link

Closed Tom-Newton closed 3 months ago

Tom-Newton commented 3 months ago

Description

The tokio runtime does not support forked processes, so fail fast if we detect this scenario

Avoids difficult to debug deadlocks
Using the deltalake python bindings with multiprocessing can easily run into this problem because the default multiprocessing start method is fork on linux systems

github-actions[bot] commented 3 months ago

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

westonpace commented 3 months ago

(ignore my review...I thought I was looking at a different repo :facepalm: )

ion-elgreco commented 3 months ago

@westonpace :P