Ticket #504 (closed defect: fixed)

Opened 4 months ago

Last modified 3 months ago

Fixed support for stereo audio all the way in pjmedia

Reported by: nanang Assigned to: nanang
Priority: normal Milestone: release-0.9.0
Component: pjmedia Version: trunk
Keywords: Cc:

Description (Last modified by bennylp)

Identified issues:

  1. The PA callbacks implementations contains wrong assertion, because of samples_per_frame misinterpretation (thanks Rodrigo Vega, http://lists.pjsip.org/pipermail/pjsip_lists.pjsip.org/2008-March/001974.html):
    • Soundport's samples_per_frame is total samples number per frame of ALL channels.
    • While PA's frameCount refers to number of samples for EACH channel.
  2. Lack of channel_count multiplication in samples_per_frame calculation in some parts of stream causing silence in stereo audio call.
  3. STEREO_DEMO in pjsua causing crash in PortAudio without call (perhaps because of some pointer to PA buffer get overwritten)
  4. Add channel_count field in pjsua_media_config to configure number of channels for both sound device and conference bridge. Add --stereo option in pjsua to change set this channel_count field to 2.
  5. Create two utility functions to:
    1. convert one mono channel audio frame to N-channel audio frame. Just duplicate the sample to all channels.
    2. convert N-channel audio from to mono audio frame. The function should have an option to either mix sample from all the channels into one channel, or to just take audio samples from one of the channel. To make the implementation simpler, we can just implement these two functions as inline functions in a new header file (e.g., stereo.h) rather than a media port.
  6. Use these channel conversion functions in the conference bridge, to convert audio samples from media ports when the media port has different channel number with the conference bridge.

Attachments

ticket504.patch (1.3 kB) - added by nanang on 03/07/08 14:51:09.
Fixed assertion param in PortAudio?'s callback implementation
ticket504.2.patch (0.5 kB) - added by nanang on 03/11/08 21:12:53.
Fixed calculation of samples_per_frame in stream port
ticket504.3.patch (1.3 kB) - added by nanang on 03/13/08 06:30:54.
- fixed calculation of samples_per_frame of conference bridge in pjsua_media - fixed number of samples supplied to store_mono_frame() in splitcomb
ticket504.4.patch (37.9 kB) - added by nanang on 03/26/08 11:26:25.
Fix issue number 4 to 6

Change History

03/07/08 14:51:09 changed by nanang

  • attachment ticket504.patch added.

Fixed assertion param in PortAudio?'s callback implementation

03/07/08 15:32:52 changed by bennylp

Patch ticket504.patch committed in r1848, thanks.

03/11/08 21:08:45 changed by nanang

  • description changed.
  • summary changed from Wrong assertion param in portaudio callbacks (thanks Rodrigo Vega) to Problem in multichannel audio.

03/11/08 21:12:53 changed by nanang

  • attachment ticket504.2.patch added.

Fixed calculation of samples_per_frame in stream port

03/11/08 22:48:13 changed by bennylp

  • summary changed from Problem in multichannel audio to Fixed support for stereo audio all the way in pjmedia.

Committed 'ticket504.2.patch' as is in r1861, thanks.

03/12/08 10:52:37 changed by bennylp

  • owner changed from nanang to bennylp.
  • status changed from new to assigned.
  • description changed.

03/12/08 10:52:55 changed by bennylp

  • owner changed from bennylp to nanang.
  • status changed from assigned to new.

03/13/08 06:30:54 changed by nanang

  • attachment ticket504.3.patch added.
  • fixed calculation of samples_per_frame of conference bridge in pjsua_media - fixed number of samples supplied to store_mono_frame() in splitcomb

03/13/08 11:15:41 changed by bennylp

Ticket ticket504.3.patch committed in r1866, thanks.

03/26/08 11:26:25 changed by nanang

  • attachment ticket504.4.patch added.

Fix issue number 4 to 6

03/29/08 13:31:48 changed by bennylp

  • status changed from new to closed.
  • resolution set to fixed.

Committed ticket504.4.patch in r1898 with the following modifications:

  • renamed function names in stereo.h:
    • pjmedia_stereo_convert_from_mono() --> pjmedia_convert_channel_1ton()
    • pjmedia_stereo_convert_to_mono() --> pjmedia_convert_channel_nto1()
  • changed the "options" argument to "mix" (boolean) since the existing enum is not a bitmask, and in nto1(), allow caller to specify which channel to be retrieved if mixing is disabled.
  • changed channel conversion algorithm to avoid multiplication in the loop
  • changed default conversion mode to mixed in conference
  • added stereo_port.c to makefiles, EVC4, and Symbian projects
  • fix channel_count field in pjmedia_conf_port_info
  • display channel count in "cl" command output in pjsua

Also committed in this revision changes to conference.c unrelated to stereo:

  • removed unnecessary vad
  • moved the conditional "if" checking outside the loop in level calculation/adjustment in get_frame() and write_port() functions.

This closes the ticket.

03/30/08 10:59:25 changed by bennylp

In r1901:

  • added missing new files!!