Closed JackCaoG closed 3 months ago
run_server takes model instead of model_name
run_server
model
model_name
I don't have write access, can someone merget his pr for me? Thanks.
Forgot to notice before. Can we also mention that this is for llama2 and also add the sharding_config flag?
Updated
run_server
takesmodel
instead ofmodel_name