southern-cross-ai / BabyJoey

Small 115 million parameter model - .5GB
Apache License 2.0
3 stars 8 forks source link

add hydra for config mangment #16

Open matthewaltenburg opened 6 days ago

matthewaltenburg commented 6 days ago

I am creating a branch to integrate Hydra into the project, which will introduce significant changes to the codebase. During this process, please limit push or pull requests to one file at a time to ensure smooth collaboration.

The main reasons for adding Hydra are:

Improved configuration management: Hydra will allow us to manage variables more effectively and customize model configurations to fit various systems, from powerful machines to smaller home setups.

Enhanced flexibility: By enabling dynamic configuration adjustments, the model will be easier to scale and adapt, making it more versatile across different hardware environments. This will allow team members to train on smaller devices without major code changes.

Future-proofing: Integrating Hydra early will help streamline future development by making the codebase more adaptable as the project evolves. It will allow us to experiment with different configurations more easily and respond quickly to new requirements.

Modular growth: Hydra will simplify the addition of new features and modules down the road, making the project more scalable and maintainable as it grows.