alisterburt / tomo_preprocessing

Other
4 stars 1 forks source link

Tomogram Generation Comparison #43

Closed EuanPyle closed 2 years ago

EuanPyle commented 2 years ago

So I've got some nice in situ data which I've been using to test the pipeline. It's now working really nicely with no obvious errors which is nice. One area which needs work is the tomograms produced by rln. For reference, here is a reconstruction of the data where the alignment was done in standalone AreTomo (AT) with local alignments and the tomogram produced by AT with SIRT like filtering: All_AT

Which looks really nice. With rln, the reconstructions with standard settings don't look so good. The alignments with IMOD (image 1) and AT (image 2) look similar quality: IMOD_CTF AreTomo_CTF

When using the --noctf flag, the tomogram becomes clearer, but still not to the quality of AT: IMOD_No_CTF AreTomo_No_CTF

I think it's pretty crucial for in situ data that the tomos look better than they do at the moment. I think the noctf ones look better but still not of the right quality. A SIRT like filter option seems p essential to add imo, and maybe noctf could be on by default (with an: Add CTF Devolution? option to take it off). I'm still looking into routines to add cryoCARE for denoising as well.

alisterburt commented 2 years ago

Thanks for the direct comparisons here @EuanPyle - couple of things to untangle...

Is it the local motion correction that's having a large effect on the tomogram quality, or is it the filtering/reconstruction method (SART I think)? Incorporating the local motion is a huge barrier and not something we can take on lightly, it would significantly complicate (potentially make impossible) the direct use of these tomograms with existing relion code for fancy refinements. We can modify the filtering relatively easily if that's the most important thing (although I don't actually know how).

is your rlnTomoHand correct/did you try the other one? This could also be why CTF makes things worse in your case...

EuanPyle commented 2 years ago

So adding correction for tilt angle offset makes a big improvement in the AreTomo tomogram quality, so that's something! Will ask for it to be incorporated into the RELION GUI as its information is included in the xf file. I'll test flipping the hand for CTF and let you know. I think both SART and local correction help, but agreed re: local motion. The tomos still look very good without local so I think SART makes a significant improvement and is definitely worth integrating. I'll try and have a look at the rln code to see how it can be implemented.

EuanPyle commented 2 years ago

Flipping the CTF tilt hand didn't make a huge difference.

inter1965 commented 2 years ago

Just encounter the same problem when reconstructing via relion4. Compared to SART reconstruction, it's hardly to pick from relion's reconstruction. Looking forward to a solution for that.

So adding correction for tilt angle offset makes a big improvement in the AreTomo tomogram quality, so that's something! Will ask for it to be incorporated into the RELION GUI as its information is included in the xf file. I'll test flipping the hand for CTF and let you know. I think both SART and local correction help, but agreed re: local motion. The tomos still look very good without local so I think SART makes a significant improvement and is definitely worth integrating. I'll try and have a look at the rln code to see how it can be implemented.

alisterburt commented 2 years ago

I'll be looking into this more today - I think there is a problem with the interpretation of the shifts

alisterburt commented 2 years ago

@inter1965 @EuanPyle could you pull tomo model, recompile, run tsa and reconstruct tomograms? This should now be fixed - the wrong data label was being used for the pixel size so shifts were calculated incorrectly

EuanPyle commented 2 years ago

@inter1965 @EuanPyle could you pull tomo model, recompile, run tsa and reconstruct tomograms? This should now be fixed - the wrong data label was being used for the pixel size so shifts were calculated incorrectly

Will do tomorrow, thanks!

EuanPyle commented 2 years ago

The results of tomo reconstruct from AreTomo look the same (as in 100% the same), just trying IMOD Patch Tracking now

EuanPyle commented 2 years ago

Tomo rec from patch tracking also looks the same (mild difference in contrast, as in, I have to click auto in 3dmod to adjust the brightness, but quality looks exactly the same)

alisterburt commented 2 years ago

Just to check, your motion corrected images weren't binned?

alisterburt commented 2 years ago

It's expected that things would look exactly the same if no binning was applied during motion correction - could you ask Shawn about the rotation center of tilt images in AreTomo?

EuanPyle commented 2 years ago

Yeah, no binning during motion cor for this dataset, so that would explain it! Sure, what specifically about the rotation center?

alisterburt commented 2 years ago

I suspected the quality decrease was due to incorrect shifts - shifts were only incorrect if images were binned during motion correction

alisterburt commented 2 years ago

Just where the rotation is in his aligned tilt-series, imod is (n-1)/2 (zero indexed)

EuanPyle commented 2 years ago

cool, have emailed!

EuanPyle commented 2 years ago

"AreTomo uses n*0.5 in zero-indexed coordinate system"

alisterburt commented 2 years ago

closing because development has moved to relion repo