Open wasertech opened 4 weeks ago
This fixes error while rust builds tokenizers wheels on python 3.12
error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --` failed with code 101
This fixes error while rust builds tokenizers wheels on python 3.12