Handling delay when Video Streaming (live) from readableStream with piping server for screen sharing

[dhr-nl]

Hi nwtgck,

I've come across your project which was really intriguing to handle live streaming an app window over HTTP(s?) to another browser. But in my own experience with my own code I'm experiencing an issue where the video on the receiving end is X seconds behind the video on the sender side. For a live stream I want the latest available frame to be seen. I thought it was a buffering/backpressure issue at first with my own code.

But even when using piping-server and the "friend-password (proof of concept for screen sharing with readable stream" repository which also builds something similar the delay is there. Do you have any insight as to how we can improve the delay/configuration when handling live streams, for regular video streaming this wouldn't be an issue, but for a screen sharing application this is quite problematic.

https://github.com/ci7lus/friend-password

[nwtgck]

Hello dhr-nl,

I also recognize this problem. I created Piping Screen Share and faced this problem. I guess converting MediaStream to ReadableStream is slow. I confirmed transferring MediaStream over WebRTC is fast.

Piping VNC, which we can view and control a shared screen, is fast.