stanford-crfm / helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
https://crfm.stanford.edu/helm
Apache License 2.0
1.91k stars 244 forks source link

Add CodeGeeX 13B (model and window service) #1169

Closed teetone closed 2 months ago

teetone commented 1 year ago

CodeGeeX is an autoregressive Transformer language model with 13B parameters, which is trained on public GitHub repositories with 20+ programming languages. It supports both multilingual code generation and crosslingual code translation.

https://github.com/THUDM/CodeGeeX

yifanmai commented 2 months ago

Closing due to (1) staleness and (2) lack of code evals in Lite. We could consider evaluating CodeGeeX4 in the future.