mehta-lab / VisCy

computer vision models for single-cell phenotyping
BSD 3-Clause "New" or "Revised" License
20 stars 2 forks source link

image translation exercise for DL@MBL #82

Open mattersoflight opened 1 month ago

mattersoflight commented 1 month ago

The students will program a UNet near the start of the course and we have scheduled image translation after segmentation and denoising exercises. We have a 6-hour window for this exercise, which will be divided between deterministic image translation and generative image translation. For deterministic image translation, we'd use UNeXt2 architecture, and for generative translation we'll probably use conditional GAN used in this paper .

Considering the above plan and the need for a demo notebook for release 0.2.0 of VisCy, I suggest that we develop a demo notebook that illustrate the training of the VSCyto3D and VSNeuromast models.

Here are Alishba's fixes to last year's exercise: https://github.com/alishbaimran/image_translation/blob/solution/solution.ipynb https://docs.google.com/document/d/1h3u42hodHN7nQz9qND-NQc7uOm72fBi7DxURNYuuYPM/edit

edyoshikun commented 1 week ago

For the release, we will add some prediction notebooks first included in #94. We will iterate on the DL@MBL notebooks afterward.