JayZhang42 / FederatedGPT-Shepherd

Shepherd: A foundational framework enabling federated instruction tuning for large language models
https://arxiv.org/pdf/2305.05644.pdf
Apache License 2.0
199 stars 31 forks source link

bad Q&A #9

Open lxr-1204 opened 5 months ago

lxr-1204 commented 5 months ago

Thank you for your excellent work. After training the llama-7b model with settings similar to yours, I found that the resulting 7B model couldn't even complete question-answering tasks. Have you experienced a similar situation?

image