leopard-ai / betty

Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization
https://leopard-ai.github.io/betty/
Apache License 2.0
329 stars 27 forks source link

Stabilize IterativeProblem #6

Closed sangkeun00 closed 2 years ago

sangkeun00 commented 2 years ago

Previously, IterativeProblem is built upon functorch. However, we found it causes slow down in training over time for unknown reasons. Therefore, we replace the dependency to functorch with:

  1. Higher
  2. TorchMeta