scivision-gallery / cryoEM-object-detection

A notebook demonstrating object detection in cryoEM micrographs
MIT License
1 stars 3 forks source link

Object Detection in CryoEM Datasets

Binder

Object detection in a synthetic dataset with ODIN

Detection of objects in a synthetic image with ODIN. Bounding boxes: purple - ground truth, yellow - prediction.

Abstract

Electron Microscopy aims to image particles (e.g., proteins, molecules) on a near atomic resolution. However, with great resolution comes low signal-to-noise ratio. As such, computer vision models need to be trained on noisy datasets in order to detect objects.

CryoEM pipeline from raw image (left, individual particle highlighted in green) to the molecular structure (right)

The structure of the objects being imaged is calculated by averaging hundreds if not thousands of frames of said object in different orientations, rotations and positions. The dataset generated is, consequently, large - usually, the pre-processed images (or with some degree of processing like motion correction) are uploaded onto an online database called EMPIAR.

In this notebook, we use scivision to load memory-friendly synthetic data (AlphabetSoup with a noise filter) and real data from the online database of EM images (EMPIAR), and run them through our pre-trained Object Detection in Images with Noise (odin) model.

How to run

To run the notebook on your local machine:

The models and data sources used in this notebook