Scalable content streaming system with server-side archiving

摘要

Some embodiments provide a scalable content streaming system that performs server-side archiving. The content streaming system includes a set of streaming server clusters, a remote storage server, and a set of distributed servers. Each streaming server cluster includes at least one streaming server and a local storage server. Each streaming server of a particular cluster distributes a content stream that is uploaded to the streaming server while also recording the content stream to the local storage server of that particular cluster. The remote storage server stores files from the local storage servers that are transferred when recording to those files is complete. The set of distributed servers distribute a live stream of content from a particular streaming server when the content is being uploaded to the particular streaming server and distribute a recorded stream of the content from the remote storage server when the upload is complete.

主权项

1. A content streaming system comprising:
a plurality of ingest clusters, each particular ingest cluster comprising (i) a plurality of streaming servers with shared access to a first local storage, (ii) at least a first network interface with which the plurality of streaming servers receive a plurality of live content streams being actively published by any of a plurality of content providers to the particular ingest cluster, and (iii) at least a first processor encoding each live content stream as a different file on the first local storage of the particular ingest cluster; at least one on-demand storage cluster comprising (i) a second storage, (ii) a second network interface communicably coupling the on-demand storage cluster to the plurality of ingest clusters, and (iii) a second processor archiving completed content streams from the plurality of ingest clusters by transferring to the second storage over the second network interface, any file from the first local storage of any of the plurality of ingest clusters corresponding to a live content stream that has ended for a specified duration, wherein the specified duration is configurable by a content provider of the live content stream; and a caching server comprising (i) a third network interface communicably coupling the caching server to the plurality of ingest clusters and the at least one on-demand storage cluster and (ii) a third processor responding to live content stream user requests by retrieving over the third network interface and forwarding over said third network interface, files from the first local storage of the plurality of ingest clusters and further responding to completed content user requests by retrieving over the third network interface and forwarding over said third network interface, files from the second storage of the on-demand storage cluster.