Ghent University Academic Bibliography

Advanced

The impact of global communication latency at extreme scales on Krylov methods

Thomas J Ashby, Pieter Ghysels, Wim Heirman and Wim Vanroose (2012) Lecture Notes in Computer Science. 7439. p.428-442
abstract
Krylov Subspace Methods (KSMs) are popular numerical tools for solving large linear systems of equations. We consider their role in solving sparse systems on future massively parallel distributed memory machines, by estimating future performance of their constituent operations. To this end we construct a model that is simple, but which takes topology and network acceleration into account as they are important considerations. We show that, as the number of nodes of a parallel machine increases to very large numbers, the increasing latency cost of reductions may well become a problematic bottleneck for traditional formulations of these methods. Finally, we discuss how pipelined KSMs can be used to tackle the potential problem, and appropriate pipeline depths.
Please use this url to cite or link to this publication:
author
organization
year
type
conference
publication status
published
subject
in
Lecture Notes in Computer Science
Lect. Notes Comput. Sci.
editor
Yang Xiang, I Stojmenovic, BO Apduhan, Guojun Wang, K Nakano and A Zomaya
volume
7439
issue title
Algorithms and architectures for parallel processing
pages
428 - 442
publisher
Springer
place of publication
Berlin, Germany
conference name
12th International conference on Algorithms and Architectures for Parallel Processing (ICA3PP-12)
conference location
Fukuoka, Japan
conference start
2012-09-04
conference end
2012-09-07
ISSN
0302-9743
ISBN
9783642330773
9783642330780
DOI
10.1007/978-3-642-33078-0_31
language
English
UGent publication?
yes
classification
C1
copyright statement
I have transferred the copyright for this publication to the publisher
VABB id
c:vabb:339803
VABB type
VABB-5
id
3003890
handle
http://hdl.handle.net/1854/LU-3003890
date created
2012-10-02 11:32:37
date last changed
2017-01-02 09:53:01
@inproceedings{3003890,
  abstract     = {Krylov Subspace Methods (KSMs) are popular numerical tools for solving large linear systems of equations. We consider their role in solving sparse systems on future massively parallel distributed memory machines, by estimating future performance of their constituent operations. To this end we construct a model that is simple, but which takes topology and network acceleration into account as they are important considerations. We show that, as the number of nodes of a parallel machine increases to very large numbers, the increasing latency cost of reductions may well become a problematic bottleneck for traditional formulations of these methods. Finally, we discuss how pipelined KSMs can be used to tackle the potential problem, and appropriate pipeline depths.},
  author       = {Ashby, Thomas J and Ghysels, Pieter and Heirman, Wim and Vanroose, Wim},
  booktitle    = {Lecture Notes in Computer Science},
  editor       = {Xiang, Yang and Stojmenovic, I and Apduhan, BO and Wang, Guojun and Nakano, K and Zomaya, A},
  isbn         = {9783642330773},
  issn         = {0302-9743},
  language     = {eng},
  location     = {Fukuoka, Japan},
  pages        = {428--442},
  publisher    = {Springer},
  title        = {The impact of global communication latency at extreme scales on Krylov methods},
  url          = {http://dx.doi.org/10.1007/978-3-642-33078-0\_31},
  volume       = {7439},
  year         = {2012},
}

Chicago
Ashby, Thomas J, Pieter Ghysels, Wim Heirman, and Wim Vanroose. 2012. “The Impact of Global Communication Latency at Extreme Scales on Krylov Methods.” In Lecture Notes in Computer Science, ed. Yang Xiang, I Stojmenovic, BO Apduhan, Guojun Wang, K Nakano, and A Zomaya, 7439:428–442. Berlin, Germany: Springer.
APA
Ashby, T. J., Ghysels, P., Heirman, W., & Vanroose, W. (2012). The impact of global communication latency at extreme scales on Krylov methods. In Y. Xiang, I. Stojmenovic, B. Apduhan, G. Wang, K. Nakano, & A. Zomaya (Eds.), Lecture Notes in Computer Science (Vol. 7439, pp. 428–442). Presented at the 12th International conference on Algorithms and Architectures for Parallel Processing (ICA3PP-12), Berlin, Germany: Springer.
Vancouver
1.
Ashby TJ, Ghysels P, Heirman W, Vanroose W. The impact of global communication latency at extreme scales on Krylov methods. In: Xiang Y, Stojmenovic I, Apduhan B, Wang G, Nakano K, Zomaya A, editors. Lecture Notes in Computer Science. Berlin, Germany: Springer; 2012. p. 428–42.
MLA
Ashby, Thomas J, Pieter Ghysels, Wim Heirman, et al. “The Impact of Global Communication Latency at Extreme Scales on Krylov Methods.” Lecture Notes in Computer Science. Ed. Yang Xiang et al. Vol. 7439. Berlin, Germany: Springer, 2012. 428–442. Print.