Closed wangpatrick57 closed 6 months ago
Previously, codellama-7b did not run on AWS g6.2xlarge machines. I made a small change in rest_test.py to match how the logic was done in gen_model_answer_rest.py, which resolved this memory issue.
rest_test.py
gen_model_answer_rest.py
Previously, codellama-7b did not run on AWS g6.2xlarge machines. I made a small change in
rest_test.pyto match how the logic was done ingen_model_answer_rest.py, which resolved this memory issue.