cvg / LightGlue

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
Apache License 2.0
3.28k stars 313 forks source link

Imge stitching #31

Open netliteIT opened 1 year ago

netliteIT commented 1 year ago

I know that this is probably not the primary focus of code/repository. But I found lightglue very efficient in my use case and I would like to merge multipl flat images (slices of a marble/granite slab). I dont have homography issues, just a little light correction and blending. Which is the preferred approach?

AydinAlptug commented 1 year ago

Hello @netliteIT,

Providing more information about your need may help the developers/researchers who may be interested. For example, maybe some experiments, example images, and expected results would be very useful.

I don't know what are your requirements but I made an experiment to merge marble images with the help of LightGlue in case it helps you. I downloaded and used sample marble images from this dataset: Kaggle Dataset

Here is the colab notebook that you can see the full output if you log in with your Google account: Colab Notebook

I have divided images into two parts where the left part contains a portion of the right part. Left part is 2/3 of the original image with a shape: 3072 x 2218 Right part is 1/2 of the original image with a shape: 2304 x 2218

The assumption is that there is a collection of images of marbles, where each image represents either the left or right part of an entire marble image. The correct positions of these images are unknown, as well as the correct pairs that form complete marble images. The notebook I provide uses LightGlue to define the correct left and right parts of the images and then stitches them together correspondingly.

Good luck Andrea

netliteIT commented 1 year ago

Hello Yusuf. I didn't expected a so exhaustive answer. Thank you. I've 10-20 photo slices of half marble slab taken at variable interval of 20-30cm and I would like to stitch them together the two set (bottom and upper). Then stitch together bottom and upper. Slides are ordered from left to right and more or less bottom and upper are aligned. I can share some examples of course. Lightglue with disk is the only way I can match points in "difficult" materials. The ideal result we would like to obtain is a complete marble slab assembled with a good overlapping parts match with a good illumination correction and real colors.