search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.96k stars 2.91k forks source link

什么时候考虑支持Mixtral8*7B呢？ #7926

Closed onewaymyway closed 4 months ago

onewaymyway commented 7 months ago

简要描述

Mixtral87B系列模型是当前开源的效果最好的模型，Mixtral87B instruct几乎可以打过chatgpt3.5，什么时候paddlenlp才能把Mixtral8*7系列的模型也支持了呢

是否已开源

模型详细信息

huggingface: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1 https://huggingface.co/mistralai/Mixtral-8x7B-v0.1

介绍： https://mistral.ai/news/mixtral-of-experts/

DesmonDay commented 7 months ago

相关PR已经提了 https://github.com/PaddlePaddle/PaddleNLP/pull/7803/files ，但由于有其他事情暂时没有更新，后续会继续支持的。

onewaymyway commented 7 months ago

相关PR已经提了 https://github.com/PaddlePaddle/PaddleNLP/pull/7803/files ，但由于有其他事情暂时没有更新，后续会继续支持的。

赞

github-actions[bot] commented 4 months ago

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动，被标记为stale。