Skip to content

Professional astrophotography, with your iPhone. Enhanced by AI.

Notifications You must be signed in to change notification settings

ju-leon/StarLens

Repository files navigation

Icon-83 5@2x

StarLens

StarGazer makes you a professional astro photographer, with the push of a button.

Using advanced algorithms and artificial intelligence, hundreds of images are combined into a single, bright photo of the night sky. This allows you take ultra long exposures, while Stargazer stabilizes the night sky for you. While tracking the sky, a timelapse of the rotating night sky is created.

Tracking

When taking pictures of the night sky, long exposures are essential to capturing all the little details. The longer you shoot, the more light your camera can capture. However, there's one problem: The night sky is moving, slowly, but surely. Professionals use expensive equipment to counteract the movements of the earth.

StarGazer solves this problem by tracking the night sky along multiple photos, and automatically aligning photos. This allows you to take ultra long exposures without getting star trails.

Bad photos are automatically recognized and not added onto the stack not to ruin your image.

stacking

AI Sky Enhancement

Using a custom trained segementation model, the sky in the image is recognized and segmented. For the segmentation model, refer to the following repo: https://github.com/ju-leon/SkySegmentation

The dataset is currently not public. Please contact me directly if you need access. Overview over the training process can be found on WandB https://wandb.ai/leonjungemeyer/stargazer-segmentation

segmentation_389_f4ebfe1e3be7957d2d87 segmentation_191_524f472014ba4177933b download

Afterwards, the stars in the sky are artifically enhanced using a UNet trained to recognize and enhance stars. This model, based on the few stars that a camera sensor in a phone is able to recognize, can generate structures that the signal to noise ratio from a normal phone sensor would never allow to make visible.

The training of the enhancement model is located here: https://github.com/ju-leon/SkyEnhancement

Overview over the training process can be found on WandB: https://wandb.ai/leonjungemeyer/stargazer-enhance

segmentation_649_94b8ed8d86007d7930ba segmentation_649_77ddb0128680737aa977-1

Screenshot 2023-04-28 at 17 28 57

screenshot

About

Professional astrophotography, with your iPhone. Enhanced by AI.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published