FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
Apache License 2.0
9.2k stars 547 forks source link

what is the helm version? #128

Open oujieww opened 10 months ago

oujieww commented 10 months ago

ImportError: cannot import name 'TokensMetric' from 'helm.benchmark.runner'

i use crfm-helm==0.4.0

hjk1231 commented 10 months ago

according to https://github.com/stanford-crfm/helm/pull/1480 we should rename TokensMetric to DryRunMetric