On-device multiplexing of streaming media content

摘要

Techniques are disclosed for multiplexing a dynamic bit-rate video stream with an audio stream received by a client device in a manner that allows the resulting multiplexed stream to be played back without disruption, despite dynamic changes in the bit rate of the video stream that may occur. A content server may stream both a video stream and an audio stream to a client device for playback. The client device may multiplex the video and audio streams prior to them being presented to a playback engine for decoding and playback to a user.

主权项

1. A computer-implemented method for encoding a media file, the method comprising:
providing a plurality of video encodings of the media file, wherein each video encoding in the plurality of video encodings encodes the media file at a different video bit rate than other video encodings in the plurality of video encodings and includes a plurality of portions of video data; for each of the plurality of video encodings:
identifying, in each of the plurality of portions of video data, one or more insertion points within the respective portion of video data at which to multiplex a portion of audio data;padding at least one portion of video data to be aligned to a continuity count boundary, andstoring, in the video encoding, a file header which includes an indication of positions of the plurality of insertion points in the video encoding; providing at least one audio encoding of the media file, wherein the audio encoding includes a header indicating a plurality of audio segments, each corresponding to one of the plurality of portions of video data; and storing the plurality of video encodings and the audio encoding on a media delivery system in order to be streamed to a client device upon request, wherein the client device is configured to generate a multiplexed stream by multiplexing streamed portions of video data with streamed portions of audio segments using the indication of positions of the plurality of insertion points in the file header of the respective video encoding.