issues
search
ZitongYang
/
Synthetic_Continued_Pretraining
Code implementation of synthetic continued pretraining
https://arxiv.org/abs/2409.07431
Apache License 2.0
60
stars
4
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Missing `lm_head` in Huggingface model
#6
bnewm0609
opened
1 month ago
0
Data Preparation of Step2 Tokenization
#5
ghtaro
closed
1 month ago
2
Inquiry about the API costs to reproduce this work:
#4
EachSheep
closed
1 month ago
5
[open-book] add EntiGraph CPT + RAG and Llama 3 Base + RAG baseline
#3
nband
closed
1 month ago
1
Benchmarks to show performance improvement
#2
XcloudFance
closed
1 month ago
1
GPU configuration
#1
DhavalRepo18
closed
1 month ago
1