Person / face detection with tensorflow lite

[wtip]

Adding person or face detection with something like tensorflow lite instead of simple motion detection would be a useful feature.

[lukeswitz]

I like this idea; motion detection needs an overhaul. Granular options, I can get behind that for sure.

Pinging @archie94 for input on which camera framework/API to move forward with (first or third party). Thanks all

[archie94]

Yes this can be a valuable add on.

We can use Framework's Camera2 apis or any wrapper over the same (Like CameraX). I believe the current camera library we have in the project can also work. Since analysis of frame are costly we can maybe analysis only certain frames at regular intervals.

We need to go with on device TFLite models like Pose estimation model or similar face detection models.

[wtip]

An app called tinyCam pro https://play.google.com/store/apps/details?id=com.alexvas.dvr.pro has an option to only do object detection on frames that contain motion. This helps reduce the CPU usage for environments where there isn't constant movement.