search

analogdevicesinc / ai8x-training

Model Training for ADI's MAX78000 and MAX78002 Edge AI Devices
Apache License 2.0
93 stars 87 forks source link

problem for enabling file #319

Closed fzh-adham closed 3 months ago

fzh-adham commented 5 months ago

Hi I want to enable distiller in training part for training here and I couldn't find a suitable command for it please guide me. thanks a lot

rotx-eva commented 5 months ago

Can you provide more detail about your network and the task you're trying to accomplish?

fzh-adham commented 5 months ago

Surely For distillation methods Such as pruning

On Thu, 20 Jun 2024, 23:42 Robert Muchsel, @.***> wrote:

Can yo provide more detail about your network and the task you're trying to accomplish?

— Reply to this email directly, view it on GitHub https://github.com/analogdevicesinc/ai8x-training/issues/319#issuecomment-2181483103, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWLZTJOT3YJ36O7D22UOAJTZIMZUBAVCNFSM6AAAAABJUI3FQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBRGQ4DGMJQGM . You are receiving this because you authored the thread.Message ID: @.***>

rotx-eva commented 5 months ago

MAX78000/MAX78002 only support channel based pruning. Is this what you're attempting to do? Distiller is not used for that functionality on MAX7800X.

fzh-adham commented 5 months ago

Thanks for reply What do u mean with channel pruning? I want to use compress methods for weights ... It means that I can't use pruning??

On Fri, 21 Jun 2024, 23:09 Robert Muchsel, @.***> wrote:

MAX78000/MAX78002 only support channel based pruning. Is this what you're attempting to do? Distiller is not used for that functionality on MAX7800X.

— Reply to this email directly, view it on GitHub https://github.com/analogdevicesinc/ai8x-training/issues/319#issuecomment-2183347421, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWLZTJPYLIZ5BIDOJSRAJM3ZIR6OBAVCNFSM6AAAAABJUI3FQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBTGM2DONBSGE . You are receiving this because you authored the thread.Message ID: @.***>

fzh-adham commented 5 months ago

could you please help me about channel based pruning? how can I use it for training? I would appreciate if you help me

rotx-eva commented 5 months ago

You can manually reduce the number of channels for your layers. To automate this, you would use the NAS. Perhaps you can describe your project and what you are trying to achieve with MAX7800X in more detail so we can assist better. Feel free to contact us using processors.support@analog.com if you don't want to publicly share that information in this thread.

fzh-adham commented 5 months ago

thanks a lot for this opportunity I have sent you message recently and I have been waiting for your reply.

github-actions[bot] commented 4 months ago

This issue has been marked stale because it has been open for over 30 days with no activity. It will be closed automatically in 10 days unless a comment is added or the "Stale" label is removed.