Home >

news ヘルプ

論文・著書情報


タイトル
和文: 
英文:Out-of-core GPU Memory Management for MapReduce-based Large-scale Graph Processing 
著者
和文: 白幡晃一, 佐藤仁, 松岡聡.  
英文: Koichi Shirahata, Hitoshi Sato, SATOSHI MATSUOKA.  
言語 English 
掲載誌/書名
和文: 
英文: 
巻, 号, ページ        
出版年月 2014年9月22日 
出版者
和文: 
英文: 
会議名称
和文: 
英文:IEEE Cluster 2014 
開催地
和文:マドリード 
英文:Madrid 
公式リンク http://www.cluster2014.org/
 
アブストラクト GPUs can accelerate edge scan performance of graph processing applications; however, the capacity of device memory on GPUs limits the size of graph to process, whereas efficient techniques to handle GPU memory overflows, including overflow detection and performance analysis in large-scale systems, are not well investigated. To address the problem, we propose a MapReduce-based out-of-core GPU memory management technique for processing large-scale graph applications on heterogeneous GPU-based supercomputers. Our proposed technique automatically handles memory overflows from GPUs by dynamically dividing graph data into multiple chunks and overlaps CPU-GPU data transfer and computation on GPUs as much as possible. Our experimental results on TSUBAME2.5 using 1024 nodes (12288 CPU cores, 3072 GPUs) exhibit that our GPU-based implementation performs 2.10x faster than running on CPU when graph data size does not fit on GPUs. We also study the performance characteristics of our proposed out-of-core GPU memory management technique, including application's performance and power efficiency of scale-up and scale-out approaches.

©2007 Institute of Science Tokyo All rights reserved.