Oxen-AI / oxen-release

Lightning fast data version control system for structured and unstructured machine learning datasets. We aim to make versioning datasets as easy as versioning code.
https://oxen.ai
Apache License 2.0
884 stars 12 forks source link

Update numpy and pyarrow to support Python 3.12 #45

Closed Eric-Laurence closed 8 months ago

Eric-Laurence commented 8 months ago

The older version of numpy used ImpImporter which has been deprecated since python 3.3, and has was removed in python 3.12. I ran into errors with pyarrow and eventually figured out that using version 15.0.* (as suggested by https://arrow.apache.org/install/) solved the problem. I did some quick testing by creating a remote repo and pushing a local repo to the remote in a jupyter notebook running python 3.12 and found no bugs.