search

exasol / transformers-extension

An Exasol extension for using state-of-the-art pretrained machine learning models via the Hugging Face Transformers API.
MIT License
2 stars 2 forks source link

Create an API for uploading a model to BucketFS equivalent to the CLI upload_model. #149

Open ahsimb opened 10 months ago

ahsimb commented 10 months ago

At the moment the way to invoke this functionality programmatically is calling three functions like this :

# Create bucketfs location
bucketfs_location = create_bucketfs_location(bfs_service, host_name, bfs_port, bfs_use_https, bfs_user, bfs_password,
    bfs_bucket, bfs_dir)
# Upload the downloaded model files into bucketfs
upload_path = get_model_path(bfs_model_dir, model_name)
upload_model_files_to_bucketfs(model_dir, upload_path, bucketfs_location)

It would be good to combine this into a single call.