Question: iOS 'Wide Spectrum' Flutter WebRTC equivalent? (Turn off noise filters)

[kNoAPP]

Let's say I'd like to optimize the WebRTC call for musicians. I want the notes they play to sound as pure as possible when traversing the peer connection. In my testing, instruments don't sound great with this library. I believe there's some filtering going on before the audio is sent over the network. Is there a supported way I can turn off high-pass/low-pass filters, noise cancelation, echo cancelation, auto gain control, etc.?

I tried passing flags through mediaConstrainsts to shut these systems off, but it doesn't seem like they were effective.

[cloudwebrtc]

I think it is technically feasible, but flutter-webrtc and libwebrtc need to be modified.

[cloudwebrtc]

You can try these constraints, but I'm not sure whether flutter-webrtc handles these constraints

https://github.com/webrtc-sdk/webrtc/blob/main/sdk/media_constraints.cc#L96-L103

[kNoAPP]

Thank you. I will give these flags a try and post an update.

[kNoAPP]

I have tried these mandatory flags in Flutter WebRTC but did not notice any difference to the call:

      'echoCancellation': false,
      'googEchoCancellation': false,
      'googEchoCancellation2': false,
      'googDAEchoCancellation': false,
      'autoGainControl': false,
      'googAutoGainControl': false,
      'googAutoGainControl2': false,
      'noiseSuppression': false,
      'googNoiseSuppression': false,
      'googNoiseSuppression2': false,
      'googHighpassFilter': false,

So I'm guessing as you said, flutter-webrtc does not handle these constraints. Tested on Android and iOS.

[kNoAPP]

How about bitrate for audio and video? Let's say I want that uncapped when possible? Can I negotiate this inside Flutter WebRTC, or will this require modification as well?

Edit: This has been solved and a reply is no longer needed.

[kNoAPP]

@cloudwebrtc Are you open to financially sponsored feature requests?

[cloudwebrtc]

@kNoAPP It would be awesome, I won’t be able to touch this code until next week, I’m crazy busy this week.

[cloudwebrtc]

@kNoAPP I have made some changes to this branch. Android seems to be able to input music very well, without ns, aec, and high-pass filtering. For iOS, I have removed audio 3A, but because of the existence of the Audio Unit's hardware EC, the sound is still Is periodically suppressed by HW AEC, I am still trying, maybe need to modify libwebrtc.
https://github.com/flutter-webrtc/flutter-webrtc/tree/feat/support-unprocessed-audio

[cloudwebrtc]

After waiting for this PR to merge, we can move forward
webrtc-sdk/webrtc#15