issues
search
exasol
/
transformers-extension
An Exasol extension for using state-of-the-art pretrained machine learning models via the Hugging Face Transformers API.
MIT License
2
stars
2
forks
source link
Remove torch package index from pyproject.toml
#181
Closed
tkilias
closed
6 months ago
tkilias
commented
6 months ago
Background
Currently, we cannot release this package to pypi, because we are using a non default package index for the torch project
The release to pypi would fix issues with releasing upstream projects, such as the notebook-connector
However, the torch package on pypi requires multiple GB of CUDA dependencies, which blow up the SLC.
We can only release SLC of the size <2GB to Github.
Proposed workaround
Remove the torch package index from pyproject
Remove the CUDA dependencies from the requirements file before building the SLC
Add the torch package index to the SLC
Background
Proposed workaround