Method and system for composing video images from a plurality of endpoints

摘要

The present application discloses a method and apparatus for a multipoint video conferencing system that can offer a wide variety of layouts and the ability to support a large number of conferees. A received stream of NALs from a plurality of endpoints can be processed by an exemplary NAL Processor Module (NPM) and be arranged into a stream of NALs that are referred to in this disclosure as organized NALs (ONALs). Two or more streams of compressed video organized into ONALs can be received by an exemplary NAL Editor Module (NEM), wherein each stream was created from a video image that was generated at an endpoint participating in the conference. An exemplary NEM can comprise a compressed composed frame memory (CCFM) module. Each CCFM can be divided into segments according to the layout of the continuous presence (CP) image that is to be displayed by one or more receiving endpoints.

主权项

1. An apparatus for processing video image data, comprising:
a compressed video data interface; and a processor that:
retrieves compressed video data representative of a video image from the compressed video data interface, wherein the compressed video data comprises network abstraction layer (NAL) units;converts the NAL units into organized NAL (ONAL) units, wherein each ONAL unit comprises compressed video data:originating from only one NAL unit; andoriginating from only one row of macroblocks (MBs) within a frame of the compressed video data; andtransmits the ONAL units to the compressed video data interface.