what is the helm version?

FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

Apache License 2.0

9.18k stars 548 forks source link

Open oujieww opened 9 months ago

oujieww commented 9 months ago

ImportError: cannot import name 'TokensMetric' from 'helm.benchmark.runner'

i use crfm-helm==0.4.0

hjk1231 commented 9 months ago

according to https://github.com/stanford-crfm/helm/pull/1480 we should rename TokensMetric to DryRunMetric