Closed ggbetz closed 2 months ago
For XX in [20b, 7b]:
XX
Check upon issue creation:
Parameters:
NEXT_MODEL_PATH=internlm/internlm2-math-{XX} NEXT_MODEL_REVISION=main NEXT_MODEL_PRECISION=bfloat16 MAX_LENGTH=2048 GPU_MEMORY_UTILIZATION=0.7 VLLM_SWAP_SPACE=8
ToDos:
For
XX
in [20b, 7b]:Check upon issue creation:
Parameters:
ToDos: