Open gallilmaimon opened 1 week ago
Hi, would love this feature as well @ylacombe
Hey @avishaiElmakies and @gallilmaimon , this would indeed be a great addition.
Would you like to open a PR to correct this ?
You'd have to add the possibility to use batch norm in the configuration_hubert.py
, propagate the change to the modeling file and the converting file, and finally add an integration test. How does it sound?
Thanks
@ylacombe Sounds good. I will work on something and let you know when the PR is ready
Feature request
Motivation
Your contribution
I can create a PR to implement this, but would love some guidance @ylacombe