Support Open MoE LLM Leaderboard

TorchMoE / MoE-Infinity

PyTorch library for cost-effective, fast and easy serving of MoE models.

Apache License 2.0

107 stars 8 forks source link

Closed lausannel closed 7 months ago

lausannel commented 7 months ago

Added a sequence ID list (seq_id_list) in the forward method call. This update prevents the AttributeError that previously occurred when invoking _loglikelihood_tokens within the HFLMWithMeasurement class.