Update sample inference code for llamma v2 7b

RupertLuo / Valley

The official repository of "Video assistant towards large language model makes everything easy"

199 stars 13 forks source link

Update sample inference code for llamma v2 7b #15

Closed RobPruzan closed 11 months ago

RobPruzan commented 11 months ago

The provided inference README code was incomplete, and I ran into inconsistencies when attempting to perform inference. This PR updates the inference code to be a working script and a small usage description within the README.

RupertLuo commented 11 months ago

Thank you for your contribution to this repository, I will merge this pull request.