analogdevicesinc / ai8x-training

Model Training for ADI's MAX78000 and MAX78002 Edge AI Devices
Apache License 2.0
85 stars 76 forks source link

problem for enabling file #319

Open fzh-adham opened 2 weeks ago

fzh-adham commented 2 weeks ago

Hi I want to enable distiller in training part for training here and I couldn't find a suitable command for it please guide me. thanks a lot

rotx-maxim commented 2 weeks ago

Can you provide more detail about your network and the task you're trying to accomplish?

fzh-adham commented 2 weeks ago

Surely For distillation methods Such as pruning

On Thu, 20 Jun 2024, 23:42 Robert Muchsel, @.***> wrote:

Can yo provide more detail about your network and the task you're trying to accomplish?

— Reply to this email directly, view it on GitHub https://github.com/analogdevicesinc/ai8x-training/issues/319#issuecomment-2181483103, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWLZTJOT3YJ36O7D22UOAJTZIMZUBAVCNFSM6AAAAABJUI3FQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBRGQ4DGMJQGM . You are receiving this because you authored the thread.Message ID: @.***>

rotx-maxim commented 2 weeks ago

MAX78000/MAX78002 only support channel based pruning. Is this what you're attempting to do? Distiller is not used for that functionality on MAX7800X.

fzh-adham commented 2 weeks ago

Thanks for reply What do u mean with channel pruning? I want to use compress methods for weights ... It means that I can't use pruning??

On Fri, 21 Jun 2024, 23:09 Robert Muchsel, @.***> wrote:

MAX78000/MAX78002 only support channel based pruning. Is this what you're attempting to do? Distiller is not used for that functionality on MAX7800X.

— Reply to this email directly, view it on GitHub https://github.com/analogdevicesinc/ai8x-training/issues/319#issuecomment-2183347421, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWLZTJPYLIZ5BIDOJSRAJM3ZIR6OBAVCNFSM6AAAAABJUI3FQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBTGM2DONBSGE . You are receiving this because you authored the thread.Message ID: @.***>

fzh-adham commented 2 weeks ago

could you please help me about channel based pruning? how can I use it for training? I would appreciate if you help me

rotx-maxim commented 1 week ago

You can manually reduce the number of channels for your layers. To automate this, you would use the NAS. Perhaps you can describe your project and what you are trying to achieve with MAX7800X in more detail so we can assist better. Feel free to contact us using processors.support@analog.com if you don't want to publicly share that information in this thread.

fzh-adham commented 1 week ago

thanks a lot for this opportunity I have sent you message recently and I have been waiting for your reply.