Dental Imaging Project – The Stitching Story

This is Avi Singh from the Dental Imaging Project being mentored by Dr. Hyunsung Park. I, along with team mate Ujjwal Baid, have been working on the Image Stitching part of the project. Most intraoral cameras have a relative narrow field of view, and the entire jaw is never visible in a single image. We are trying to stitch several images into one, so that the user has complete view of the jaw, and we can then segment the tooth from it, and keep a track for every individual tooth.

A basic image stitching pipeline has the following steps:
1. Matching features between two images
2. Computing the homography with RANSAC (minimal set is four matches)
3. Transforming , concatenating and blending the images.

Most of the existing panaroma building algorithms are well-suited for applications in which the object being photographed is quite far away from the camera, such as in the image shown below:

However, we are photographing the teeth at a really close range, and minor changes in perspective are fatal for these algorithms. In order to overcome the problems imposed by changes in perspective, we are using ASIFT, a feature detection/description/matching algorithm which is robust to perspective changes when compared to SIFT. The next steps (homography computation, blending) are pretty standard, and here are some results:

A stitch of three images taken from an intraoral camera.

A stitch of three images taken from an intraoral camera.

We have now started working on segmenting the teeth from rest of the image, and will soon update!
Here is me (in red t-shirt) and Ujjwal in action with the intraoral camera:
IMG_5793The Team: Hyunsung Park (mentor), Avi Singh, Ujjwal Baid, Raghu, Meghasyam, Ashish Bora, Ashray Malhotra, Pratima Mokashi, Samriddh Hada