Integration Kerberos.io

[cedricve]

Hey @gagle,

Amazing project! It's a shame that I've didn't find this earlier, I have been using Raspicam since 2015, but never found your project.

I'm planning to integrate this in the @kerberos-io www.kerberos.io project, as I have the feeling we would have a huge performance improvement by doing so. Not sure if you are open to advice/help, as it has been a while since this project has been updated.

I'm a huge fan already.

Cédric

[gagle]

Hi @cedricve Your project is also amaizing, in fact, this is what I liked to do in the past with the omxcam lib that I wrote, real-time streaming frlm the rpi to the browser using nodejs as backend. I stopped the development because the browsers didn't support the h264 codec. Now all of them support it as cisco open sourced its implementation. I always wanted to continue the development but I've never had the time but now with your project maybe we can do something interesting. I am open to any suggestion. I'm totally disconnected from the rpi world. Do you know what's the current state about the mmal lib? if they open sourced it or any news from the past 3 years?

[cedricve]

Amazing! we should have a skype call to align, and see what would work for both us. Can you send me an invitation to [email protected]

I'm looking forward!

Cédric

[cedricve]

hey @gagle, started with the integration of your library. Pretty forward though! However it will be a challenging problem to run video recording (h264) and jpeg still captures (for motion) in parallell. As far I've understood correctly on the blog you've discussed you can't run both at the same time.

Also is it necesarry to open and close the camera each time you grab a still image. Isn't there a way to grab multiple images (with the same camera settings)? Because it looks that opening/initializing the camera takes about 500ms (according the settings you've chosen).

Cédric

[gagle]

Sorry for the late response. I would like to contribute but after work I have a very limited time to spend on it. What I'd like to do if I get involved again is to review the lib in C and nodejs native bindings; the multithread nature of the project and the data transfer between thread was a bit complex. But for sure, I can remember that you weren't allowed to capture still images and video at the same time because images have a higher resolution. I don't know very well how you could extract high-res stills while capturing. I'm not sure if the camera app from android can do this aswell, I'll take a look. I never investigated multi-still mode without closing the camera, that's one thing I'd like to know too. -------- Original message --------From: Cédric Verstraeten <[email protected]> Date: 5/27/17 13:53 (GMT+01:00) To: gagle/raspberrypi-omxcam <[email protected]> Cc: Gabriel Llamas <[email protected]>, Mention <[email protected]> Subject: Re: [gagle/raspberrypi-omxcam] Integration Kerberos.io (#5) hey @gagle, started with the integration of your library. Pretty forward though! However it will be a challenging problem to run video recording (h264) and jpeg still captures (for motion) in parallell. As far I've understood correctly on the blog you've used to discuss you can't run both at the same time. Also is it necesarry to open and close the camera each time you grab a still image. Isn't there a way to grab multiple images (with the same camera settings)? Cédric — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread. {"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/gagle/raspberrypi-omxcam","title":"gagle/raspberrypi-omxcam","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/gagle/raspberrypi-omxcam"}},"updates":{"snippets":[{"icon":"PERSON","message":"@cedricve in #5: hey @gagle, started with the integration of your library. Pretty forward though! However it will be a challenging problem to run video recording (h264) and jpeg still captures (for motion) in parallell. As far I've understood correctly on the blog you've used to discuss you can't run both at the same time.\r\n\r\nAlso is it necesarry to open and close the camera each time you grab a still image. Isn't there a way to grab multiple images (with the same camera settings)?\r\n\r\nCédric"}],"action":{"name":"View Issue","url":"#5 (comment)"}}}

[cedricve]

@gagle no problem at all! That would be wonderful, I would love to help you 👍 I think with two brains, we can progress faster and challenge possible solutions. Integration with Node is also on my todo list.

For the time being the most urgent part from my side (for Kerberos.io) is to get a parallel stream (video_splitter) I guess. I would need to open the preview port, to capture decoded cv::Mat for doing image processing, and a video port for video encoding (recording the h264 stream).

With your code it's possible, like you've stated in one of the forums, to capture stills by opening and closing the image port, and in its turn opening the video port when a specific action occurred. The resulting video FPS and resolution is wonderful, however the blocking mechanism isn't the most ideal situation. From a video surveillance perspective there should be multithreading, to make sure the video_encode keeps running while activity is happing (e.g. motion). While an action is happening (someone is walking by) we need to keep recording while the pedestrian is out of the camera viewport.

I've added a comment to your original forum post https://www.raspberrypi.org/forums/viewtopic.php?f=43&t=72523&start=50, but it still needs approval though.

[cedricve]

References:

https://www.raspberrypi.org/forums/viewtopic.php?f=70&t=98197
https://github.com/dridri/OpenMaxIL-cpp/blob/master/src/VideoSplitter.cpp
http://picamera.readthedocs.io/en/release-1.13/recipes2.html#capturing-images-whilst-recording

Also wondering if we could replace the OMX.broadcom.null_sink component by an image encoder, le me know your thoughts about this @gagle.