search

XuezheMax / megalodon

Reference implementation of Megalodon 7B model
MIT License
507 stars 53 forks source link

any opensource weights? #1

Open hijkzzz opened 7 months ago

XuezheMax commented 7 months ago

The model checkpoint is still under Meta AI legal review. We will release it once we get the approval. Thanks.

pszemraj commented 6 months ago

hey @XuezheMax , great work! just wanted to see if there are any updates :)

kalomaze commented 2 months ago

i concur

kalomaze commented 2 months ago

concurring again @XuezheMax ?

XuezheMax commented 2 months ago

@kalomaze I haven't got any updates from Meta AI on model releasing :-(

mylesgoose commented 2 months ago

@kalomaze I haven't got any updates from Meta AI on model releasing :-(

can you provide a scrip to convert an existing model like llama3.1 8b to use this method or to train another new one. cheers.