search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
74 stars 26 forks source link

feat: add TEI GPU & CPU image #77

Closed haixiw closed 3 months ago

haixiw commented 3 months ago

Issue #, if available:

Description of changes:

  1. add TEI CPU & GPU image
  2. update sagemaker tests to cover TEI images with HF model inference tests

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

amzn-choeric commented 3 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

haixiw commented 3 months ago

The codebuild should pass when CR-128226893 's merged