ASC-Competition ASC24-LLM-inference-optimization issues - Githubissues

ASC-Competition / ASC24-LLM-inference-optimization

The dataset and baseline code for ASC23 LLM inference optimization challenge.

31 stars 6 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

About total token

#8 Thewillman opened 8 months ago
3
About total token

#7 Traveller2001 closed 8 months ago
1
Want a discussion area here in this repository for we competitors to discuss and learn from each other.

#6 Kevin-shihello-world opened 8 months ago
0
How about some ml-based method?

#5 Thewillman opened 8 months ago
0
Whether to allow methods that use multiple model copies

#4 Traveller2001 closed 8 months ago
1
Regarding Specific Guidance on Building an Inference System

#3 Lvjinhong closed 8 months ago
3
The weights file link provided is not consistent with the baseline code

#2 haroqiu closed 7 months ago
1
Is that we should fully use all 70b parameter? I mean can we use some skill like discrimination to make it smaller Or use another some small model to help its inference Or separate the whole big model into some small part and use Moe to help it move faster?

#1 Kevin-shihello-world opened 8 months ago
6