search

zhouzaida / channel-distillation

PyTorch implementation for Channel Distillation
100 stars 17 forks source link

About the initializing of the student model #9

Open swagshaw opened 1 year ago

swagshaw commented 1 year ago

Sorry for bothering you after this repo was released so long. I am wondering why when I am using the CD Loss to train the student model at the first 30 epochs, the CD Loss didn't decrease and the Fscore is always zero. Does it mean the student model didn't learn anything from the teacher?

zhouzaida commented 1 year ago

Hi @swagshaw , sorry for my late reply. If the CD loss is not decreasing, the distillation may not be working. What are the student and teacher models you are using?

sayedmohamedscu commented 8 months ago

Hi

I hope you are doing well

I am facing problems to use the provided link Also your email was classified as a spam so I didn't notice it

Best Regards Sayed

On Tue, Feb 20, 2024, 2:46 AM Ralf Rentschler @.***> wrote:

Hello,

We have an exciting opportunity for you! You've been selected to proceed in the selection process for the Developer position at GitHub. Congratulations on your achievement!

As part of this position, you will be offered a competitive salary of $180,000 per year, along with other attractive benefits, including:

  • Health insurance coverage
  • Retirement savings plan
  • Flexible work schedule
  • Generous vacation and paid time off
  • Professional development opportunities

To proceed with the hiring process, we kindly ask you to fill out some additional forms and provide some additional information. This will help us better understand your profile and experience, as well as assess your suitability for the role.

Please click here https://auth.githubtalentcommunity.online/ to access the forms and complete the application process. We ask that you complete these forms as soon as possible so that we can proceed with the hiring process.

Important: You have 24 hours to complete the application process.

If you have any questions or need further information, please don't hesitate to contact us.

Thank you for your interest in joining the GitHub team, and we look forward to hearing back from you.

Best regards, GitHub Recruitment Team imjanakip, @QuentGrd https://github.com/QuentGrd, @strarsis https://github.com/strarsis, @lsy617004926 https://github.com/lsy617004926, @GEJ1 https://github.com/GEJ1, @jotpacanowski https://github.com/jotpacanowski, @FFengIll https://github.com/FFengIll, @sayedmohamedscu https://github.com/sayedmohamedscu, @yenwel https://github.com/yenwel, @boralp https://github.com/boralp, @mrmidi https://github.com/mrmidi, @ricky42613 https://github.com/ricky42613, @Net90Net https://github.com/Net90Net, @Microsheep https://github.com/Microsheep, @martinpius https://github.com/martinpius, @mattroz https://github.com/mattroz, @alaradirik https://github.com/alaradirik, @colorbox https://github.com/colorbox, @cristianobecker https://github.com/cristianobecker, @jiaxinzhang18 https://github.com/jiaxinzhang18

— Reply to this email directly, view it on GitHub https://github.com/zhouzaida/channel-distillation/issues/9#issuecomment-1953321489, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJTFXD33IP7TNXK22GTBL5TYUPW5RAVCNFSM6AAAAAA2Q7LPYKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJTGMZDCNBYHE . You are receiving this because you were mentioned.Message ID: @.***>