发明名称 |
Model Parallel Processing Method and Apparatus Based on Multiple Graphic Processing Units |
摘要 |
A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including a plurality of GPUs; binding each worker thread to a corresponding GPU; loading one batch of training data from a nonvolatile memory to a GPU video memory corresponding to one worker group; transmitting, between a plurality of GPUs corresponding to one worker group, data required by data processing performed by the GPUs through peer to peer; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads. |
申请公布号 |
US2016321776(A1) |
申请公布日期 |
2016.11.03 |
申请号 |
US201515107475 |
申请日期 |
2015.06.19 |
申请人 |
TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED |
发明人 |
Zou Yongqiang;Li Yi;Jin Xing;Xiao Bin;Guo Zhimao;Xue Wei;Chen Bo;Li Yong;Xiao Lei |
分类号 |
G06T1/20 |
主分类号 |
G06T1/20 |
代理机构 |
|
代理人 |
|
主权项 |
1. A parallel data processing method based on multiple graphic processing units (GPUs), comprising:
creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups comprising a plurality of GPUs; binding each worker thread to a corresponding GPU; loading one batch of training data from a nonvolatile memory to a GPU video memory corresponding to one worker group; transmitting, between a plurality of GPUs corresponding to one worker group, data required by data processing performed by the GPUs through peer to peer; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads. |
地址 |
Shenzhen, Guangdong CN |