facebookresearch / NeuralCompression

A collection of tools for neural compression enthusiasts.
MIT License
509 stars 44 forks source link

Models refactor #196

Closed mmuckley closed 1 year ago

mmuckley commented 1 year ago

This PR refactors the models of NeuralCompression. At a high level it does two things:

  1. We remove all duplicate model implementations that are currently implemented in CompressAI.
  2. We add an implementation of HiFiC, which will be later used for the downstream open-sourcing of MS-ILLM.

As we plan to use several variants of the Hyperprior model, we do introduce a new abstract base class for hyperprior models that encapsulates the HiFiC autoencoder. This will make it easier to build a common interface for training loops involving these classes of models.

The test suite has also been updated to test the new HiFiC autoencoder and its functionality, as well as removing old tests that references deleted code.

mmuckley commented 1 year ago

Merging after offline discussion with reviewer.