search

stanford-crfm / helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
https://crfm.stanford.edu/helm
Apache License 2.0
1.94k stars 250 forks source link

Installation Guide: Required Dependencies for Supported Operating Systems and Distributions #3160

Open shakatoday opened 13 hours ago

shakatoday commented 13 hours ago

The installation guide currently lacks detailed information on the dependencies required for various supported operating systems and distributions. To help users set up the project smoothly, we should add a section in docs/installation.md that outlines the dependencies for each supported OS and distro (e.g., Ubuntu, Debian, macOS, etc.). This will ensure that users have a clear understanding of the prerequisites and can avoid common setup issues.

yifanmai commented 6 hours ago

Are you running into an issue with a specific distro? I believe HELM should work on Ubuntu and MacOS; Debian hasn't been tested but I don't see why it wouldn't work.

There is a known issue that HELM doesn't work on Windows; see #2907.