-
**Is your feature request related to a problem? Please describe.**
Currently we are hosting Open Source Models like Mixtral-8x7B with the Hugging Face Inference Endpoint. With the new tgi 1.4 Version…
-
After https://github.com/pandas-dev/pandas/pull/55901, we now do inference of the best resolution, and so allow to create non-nanosecond data by default (instead of raising for out of bounds data).
…
-
Is there a batch inference API available? In our use case, we need to perform inference on several (up to 100+) cropped parts of an image. A batch inference API would make this operation efficient. Th…
-
### Feature request
It would be amazing if 0-shot text classifiers that are designed to work with the [HF zeroshot pipeline](https://huggingface.co/docs/transformers/en/main_classes/pipelines#transfo…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
Predict
### Bug
I sent…
-
### Initial Checks
- [ ] I have searched GitHub for a duplicate issue and I'm sure this is something new
- [ ] I have read and followed [the docs & demos](https://github.com/modelscope/modelscope-age…
-
能否给个教程
-
Come up with a comprehensive plan with justifications about how to go about the entire profiling process. Examples of important questions to answer:
- Do models on the final list for profiling have…
-
**Abstract**
Individual frameworks such as uTensor and TFLM have their own sets of on-device APIs. In some cases, significant boilerplate code and framework-specific knowledge are required to impleme…
-
**Describe the feature**
Typically OpenAI API's are protected with some API_KEY, so to run requests to such API's it is necessary to specify API_KEY in a call.
Is it planned to add such functionalit…