exasol / transformers-extension

An Exasol extension for using state-of-the-art pretrained machine learning models via the Hugging Face Transformers API.

MIT License

2 stars 2 forks source link

Remove torch package index from pyproject.toml #181

Closed tkilias closed 6 months ago

tkilias commented 6 months ago

Background

Currently, we cannot release this package to pypi, because we are using a non default package index for the torch project
- The release to pypi would fix issues with releasing upstream projects, such as the notebook-connector
However, the torch package on pypi requires multiple GB of CUDA dependencies, which blow up the SLC.
We can only release SLC of the size <2GB to Github.

Proposed workaround

Remove the torch package index from pyproject
Remove the CUDA dependencies from the requirements file before building the SLC
Add the torch package index to the SLC