search

1-800-BAD-CODE / punctuators

Package for inference for punctuation, true-casing, and sentence boundary detection
23 stars 2 forks source link

Allow user to pass onnxruntime providers option #11

Closed trunglebka closed 5 months ago

trunglebka commented 5 months ago

When using the CUDAExecutionProvider with the default configuration, some settings will drastically affect the inference speed. For example, cudnn_conv_algo_search (default=EXHAUSTIVE) will make a variable input network drastically slower compared to HEURISTIC.

Or it is simply that we just don't want to use Cuda... This change gives users the ability to pass such options.

1-800-BAD-CODE commented 5 months ago

Thanks, this is part of the latest release 0.0.7