segmind / segmoe

Apache License 2.0
409 stars 24 forks source link

How to finetune the segmoe and train lora #23

Open trouble-maker007 opened 8 months ago

trouble-maker007 commented 8 months ago

Is there any finetune the segmoe and train lora tutorials in the future?

Warlord-K commented 7 months ago

Yes, we are working on finetuning the models, it might take a bit as we are working reducing the memory usage first.