rfeinman / pytorch-minimize

Newton and Quasi-Newton optimization with PyTorch
https://pytorch-minimize.readthedocs.io
MIT License
292 stars 34 forks source link

Constrained minimization via the Frank-Wolfe method #28

Open calvinmccarter opened 10 months ago

calvinmccarter commented 10 months ago

I've implemented Frank-Wolfe solvers for the constraints $||X||_{tr} < t$ and $X \in \mathcal{B}_n$, the Birkhoff polytope. In both cases, these are just using the vanilla Frank-Wolfe method. I've added a few tests too.

In the future, I'd like to add improved versions of Frank-Wolfe (eg better step sizes, away-step updates), and implement a few more constraints.