Implement Support for Advanced Optimizers

[ravin-d-27]

Add support for advanced optimization algorithms like Adam, RMSprop, and AdaGrad to enhance the convergence speed and improve performance on complex datasets.

Objective:
Enable users to select from multiple optimizers to better suit their model training needs.

Implementation Suggestions:

• Create an Optimizer class with methods for Adam, RMSprop, and AdaGrad.
• Allow users to specify the optimizer type in model configuration.
• Test optimizers with different learning rates to evaluate performance.

[Abhinavexists]

i can work on this .

[ravin-d-27]

Hi @Abhinavks1405 . Thank you for your interest. I am assigning this issue to you.

[ravin-d-27]

Hi @Abhinavks1405, can you let me know your status?

[Abhinavexists]

@ravin-d-27 , Hi i am currently working on advance optimisers right now but it is taking time .

[ravin-d-27]

That's great @Abhinavks1405 👍😃

[Abhinavexists]

@ravin-d-27 currently added optimizers.py and trying to make them work with model and main.py

[ravin-d-27]

Thanks for the update @Abhinavks1405 ! Please take your time 🙂

[ravin-d-27]

Hi @Abhinavks1405 ! Could you please let me know your status?

[Abhinavexists]

was working on in , resolving issues with how optimizer file was interacting with rest of model.py and device.py

[ravin-d-27]

Thanks for the update! Please remember to pull the main branch and start working on..