Closed drow931 closed 1 year ago
Use towhee.build_pipeline_model
to create Triton models without using Docker. wiki: https://towhee.readthedocs.io/en/latest/triton/triton.html
And then build a docker image to run the models, need to install some deps Some example dockerfiles: https://github.com/towhee-io/towhee/tree/main/towhee/serve/triton/dockerfiles
nice
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Close the stale issues and pull requests after 7 days of inactivity. Reopen the issue with /reopen
.
Is there an existing issue for this?
Current Behavior
When executing towhee.build_docker_image, the op contains a local private BERT model, and the following error occurs: factory.py-factory:118 - ERROR: Loading operator with error: yyyy/chinese-bert-wwm-ext is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
Which level directory in the docker should this model be copied to?
Expected Behavior
No response
Steps To Reproduce
No response
Environment
Anything else?
No response