search

ai-computing / aicomp

Other
6 stars 0 forks source link

Llama model support #20

Open ememos opened 1 month ago

ememos commented 1 month ago

Support for the Llama model is needed.

ememos commented 4 days ago

Meta-Llama-3-8B model is supported (however, PyTorch version 2.3.1 or higher is required).

ememos commented 4 days ago

Tested configuration for Meta-Llama-3-8B model :

The GPU used in the test is the A40.