Advanced search
1 file | 110.88 KB Add to list

Restating the case for weighted-IPC metrics to evaluate multiprogram workload performance

Stijn Eyerman (UGent) and Lieven Eeckhout (UGent)
Author
Organization
Abstract
Weighted speedup is nowadays the most commonly used multiprogram workload performance metric. Weighted speedup is a weighted-IPC metric, i.e., the multiprogram IPC of each program is first weighted with its isolated IPC. Recently, Michaud questions the validity of weighted-IPC metrics by arguing that they are inconsistent and that weighted speedup favors unfairness [4]. Instead, he advocates using the arithmetic or harmonic mean of the raw IPC values of the programs in the multiprogram workload. We show that weighted-IPC metrics are not inconsistent, and that weighted speedup is fair in giving equal importance to each program. We argue that, in contrast to raw-IPC metrics, weighted-IPC metrics have a system-level meaning, and that raw-IPC metrics are affected by the inherent behavior of the programs. We also show that the choice of a metric may adversely affect the conclusions from an experiment. We suggest to use two weighted-IPC metrics-system throughput (STP) and average normalized turnaround time (ANTT)-for evaluating multiprogram workload performance, and to avoid raw-IPC metrics.

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 110.88 KB

Citation

Please use this url to cite or link to this publication:

MLA
Eyerman, Stijn, and Lieven Eeckhout. “Restating the Case for weighted-IPC Metrics to Evaluate Multiprogram Workload Performance.” IEEE COMPUTER ARCHITECTURE LETTERS 13.2 (2013): 93–96. Print.
APA
Eyerman, S., & Eeckhout, L. (2013). Restating the case for weighted-IPC metrics to evaluate multiprogram workload performance. IEEE COMPUTER ARCHITECTURE LETTERS, 13(2), 93–96.
Chicago author-date
Eyerman, Stijn, and Lieven Eeckhout. 2013. “Restating the Case for weighted-IPC Metrics to Evaluate Multiprogram Workload Performance.” Ieee Computer Architecture Letters 13 (2): 93–96.
Chicago author-date (all authors)
Eyerman, Stijn, and Lieven Eeckhout. 2013. “Restating the Case for weighted-IPC Metrics to Evaluate Multiprogram Workload Performance.” Ieee Computer Architecture Letters 13 (2): 93–96.
Vancouver
1.
Eyerman S, Eeckhout L. Restating the case for weighted-IPC metrics to evaluate multiprogram workload performance. IEEE COMPUTER ARCHITECTURE LETTERS. 2013;13(2):93–6.
IEEE
[1]
S. Eyerman and L. Eeckhout, “Restating the case for weighted-IPC metrics to evaluate multiprogram workload performance,” IEEE COMPUTER ARCHITECTURE LETTERS, vol. 13, no. 2, pp. 93–96, 2013.
@article{4192833,
  abstract     = {Weighted speedup is nowadays the most commonly used multiprogram workload performance metric. Weighted speedup is a weighted-IPC metric, i.e., the multiprogram IPC of each program is first weighted with its isolated IPC. Recently, Michaud questions the validity of weighted-IPC metrics by arguing that they are inconsistent and that weighted speedup favors unfairness [4]. Instead, he advocates using the arithmetic or harmonic mean of the raw IPC values of the programs in the multiprogram workload. We show that weighted-IPC metrics are not inconsistent, and that weighted speedup is fair in giving equal importance to each program. We argue that, in contrast to raw-IPC metrics, weighted-IPC metrics have a system-level meaning, and that raw-IPC metrics are affected by the inherent behavior of the programs. We also show that the choice of a metric may adversely affect the conclusions from an experiment. We suggest to use two weighted-IPC metrics-system throughput (STP) and average normalized turnaround time (ANTT)-for evaluating multiprogram workload performance, and to avoid raw-IPC metrics.},
  author       = {Eyerman, Stijn and Eeckhout, Lieven},
  issn         = {1556-6056},
  journal      = {IEEE COMPUTER ARCHITECTURE LETTERS},
  language     = {eng},
  number       = {2},
  pages        = {93--96},
  title        = {Restating the case for weighted-IPC metrics to evaluate multiprogram workload performance},
  url          = {http://dx.doi.org/10.1109/L-CA.2013.9},
  volume       = {13},
  year         = {2013},
}

Altmetric
View in Altmetric
Web of Science
Times cited: