Evaluate: ai21labs/Jamba-v0.1

[ggbetz]

Check upon issue creation:

• [x] The model has not been evaluated yet and doesn't show up on the CoT Leaderboard.
• [x] There is no evaluation request issue for the model in the repo.
• [ ] Wait for Jamba support in vllm or implement HF transformers evaluation, and update cot-eval container
• [ ] The parameters below have been adapted and shall be used.

Parameters:

NEXT_MODEL_PATH=<org>/<model>
NEXT_MODEL_REVISION=main
NEXT_MODEL_PRECISION=float16
MAX_LENGTH=2048 
GPU_MEMORY_UTILIZATION=0.8
VLLM_SWAP_SPACE=4

ToDos:

• [ ] Run cot-eval pipeline
• [ ] Merge pull requests for cot-eval results datats (> @ggbetz)
• [ ] Create eval request record to update metadata on leaderboard (> @ggbetz)