issues
search
ASC-Competition
/
ASC24-LLM-inference-optimization
The dataset and baseline code for ASC23 LLM inference optimization challenge.
31
stars
6
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
About total token
#8
Thewillman
opened
8 months ago
3
About total token
#7
Traveller2001
closed
8 months ago
1
Want a discussion area here in this repository for we competitors to discuss and learn from each other.
#6
Kevin-shihello-world
opened
8 months ago
0
How about some ml-based method?
#5
Thewillman
opened
8 months ago
0
Whether to allow methods that use multiple model copies
#4
Traveller2001
closed
8 months ago
1
Regarding Specific Guidance on Building an Inference System
#3
Lvjinhong
closed
8 months ago
3
The weights file link provided is not consistent with the baseline code
#2
haroqiu
closed
7 months ago
1
Is that we should fully use all 70b parameter? I mean can we use some skill like discrimination to make it smaller Or use another some small model to help its inference Or separate the whole big model into some small part and use Moe to help it move faster?
#1
Kevin-shihello-world
opened
8 months ago
6