search

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution
Apache License 2.0
183 stars 58 forks source link

Add llama-3 lora test #2027

Closed rohithkrn closed 1 month ago

rohithkrn commented 1 month ago

Description

Adds llama-3-8b lora test for vllm and lmi-dist.

Tested locally.