发明名称 A method and system for scalable job processing
摘要 <p>Methods and system for processing jobs within a cluster of processor nodes connected via a network. Jobs are received 701 at a node from clients or another node and are processed 702 until they are waiting upon external dependencies 706 such as network I/O or information from and external internet service. Waiting jobs are paused 707, which may involve saving state, and another job processed 708 until the external dependency is completed when the first job is continued 709. Job requests can include task parameters and definition type from which the job is de-serialised into an executable object. The processing of jobs can spawn child jobs 704 to perform sub-tasks 703 which are then allocated 705. Another method comprises the transmission of messages relating to the ongoing processing of jobs back to a client via a persistent messaging channel which can be based upon a Universal Unique Identifier (UUID) included in each job. Yet another method comprises determining capacity at a node before allocating a job for processing by the node or adding the job to a cluster queue.</p>
申请公布号 GB201414463(D0) 申请公布日期 2014.10.01
申请号 GB20140014463 申请日期 2014.08.14
申请人 IMPORT.IO LIMITED 发明人
分类号 主分类号
代理机构 代理人
主权项
地址