Image registration

WORK IN PROGRESS

Registration

Registration is the process of aligning a set of images so that they can be used as if taken from the same point of view, in astronomy this applies to aligning images in order to be able to stack them. This page contains a comprehensive list of registration methods documented in bibliography or in amateur astronomy image processing software. With the development of Siril, it has been quite a challenge to choose and implement a registration method that works well when atmospheric turbulence affects distances between items in the images, which happens in high-resolution imaging or simply planetary images.

Most algorithms need a reference image to compare and align all other images of the set to. In some cases, like lucky-imaging planetary images, this reference image cannot be taken from the main sequence because they are too noisy and have a poor contrast. Creating it can be a challenge of its own.

Some registration methods can compute sub-pixel alignment parameters, in particular for field rotation. While this is very precise information, one has to wonder if the loss of data accuracy inherent to the redistribution of pixel information in neighbouring pixels is worth the sub-pixel alignment. Super-resolution and drizzle techniques may come to help here.

Star alignment methods

Stars appearing in deep-sky images are very good points of interests to use to align images. Their light is distributed on photosites of the sensor following a Gaussian law, see the article on PSF, meaning that the peak of this Gaussian curve can be used to precisely know where the star is in the image, to a sub-pixel scale. Aligning two images is then a matter of overlapping the positions of some stars identified in the two images, but identifying which star in an image is the same as in another can be difficult, especially when field rotation occurs. In most algorithms, characterizing a star is only possible when the star is not saturated in the image.

One-star alignment

In most simple cases, an isolated star can be used to align all images of the sequence. Images acquired with an equatorial mount telescope or in a short timespan generally suffer of low enough field rotation to make this method advantageous.

Pros:

• very fast
• very easy to implement

Cons:

• translation only, no field rotation
• movement of the star across images of the set should not approach the mean distance in pixels between the star and its neighbour or the star can be mixed up with another at some point and registration would be completely wrong

Multiple-star alignment

If input images are misaligned by a large amount or suffer from field rotation, using a single star for registration is not possible, and using several can be as much challenging. The triangle similarity algorithm [1], a general purpose geometry matching function, can be used very well in star field images. Triangles are formed with bright stars, and matching triangles are a good indicator of similar fields of view. The transformation required to pass from a triangle to another can then be used to transform the images in order to align them. Two triangles identified already provides pretty good confidence.

Pros:

• accurate with many stars in the field of view
• translation, rotation and even more complex operations can be detected

Cons:

• slower than single-star
• works only when at least the same 6 bright stars are visible on all images

Pattern recognition methods

Close-up views of bright nebulas, galaxies or planets may require a specific approach to image registration, based on pattern recognition. An example of such an algorithm would be to try aligning two clouds pictures, the brightness difference in clouds regions or the shape of their contour could be used.

Fourier transform based

Fourier transform is a very powerful tool in signal processing and image processing. An image can be seen as set of signals of various frequencies, amplitudes and phases. Two similar images shifted will have the same frequencies and amplitudes but different phases.

Other are coming

multi-point pattern matching, alignment points and their size, image distorsion...