Support Open MoE LLM Leaderboard

TorchMoE / MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

Apache License 2.0

88 stars 5 forks source link

Closed lausannel closed 4 months ago

lausannel commented 4 months ago

Added a sequence ID list (seq_id_list) in the forward method call. This update prevents the AttributeError that previously occurred when invoking _loglikelihood_tokens within the HFLMWithMeasurement class.