search

DAMO-NLP-SG / SeaLLMs

[ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
140 stars 14 forks source link

Hyperparameters #7

Open ekurtulus opened 6 months ago

ekurtulus commented 6 months ago

What are the hyperparameters for replicating SeaLLMs/SeaLLM-7B-v1 and SeaLLMs/SeaLLM-7B-v2 ?

nxphi47 commented 6 months ago

@ekurtulus Hi there.

The models are trained on close-sourced data, so I'm not sure if it is replicable.

Cheers.

ekurtulus commented 6 months ago

@ekurtulus Hi there.

The models are trained on close-sourced data, so I'm not sure if it is replicable.

Cheers.

Similar size and quality datasets can still be curated. That's why I believe the community would be interested in hyperparameters.