Advanced search
1 file | 436.81 KB

Multiprogram throughput metrics: a systematic approach

Author
Organization
Abstract
Running multiple programs on a processor aims at increasing the throughput of that processor. However, defining meaningful throughput metrics in a simulation environment is not as straightforward as reporting execution time. This has led to an ongoing debate on what forms a meaningful throughput metric for multiprogram workloads. We present a method to construct throughput metrics in a systematic way: we start by expressing assumptions on job size, job distribution, scheduling, and so forth that together define a theoretical throughput experiment. The throughput metric is then the average throughput of this experiment. Different assumptions lead to different metrics, so one should be aware of these assumptions when making conclusions based on results using a specific metric. Throughput metrics should always be defined from explicit assumptions, because this leads to a better understanding of the implications and limits of the results obtained with that metric. We elaborate multiple metrics based on different assumptions. In particular, we identify the assumptions that lead to the commonly used weighted speedup and harmonic mean of speedups. Our study clarifies that they are actual throughput metrics, which was recently questioned. We also propose some new throughput metrics, which cannot always be expressed as a closed formula. We use real experimental data to characterize metrics and show how they relate to each other.
Keywords
Experimentation, SIMULATION, throughput metrics, Performance, Multi-program workloads, SIMULTANEOUS MULTITHREADING PROCESSOR, multicore, Measurement, simultaneous, multithreading

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 436.81 KB

Citation

Please use this url to cite or link to this publication:

Chicago
Eyerman, Stijn, Pierre Michaud, and Wouter Rogiest. 2014. “Multiprogram Throughput Metrics: a Systematic Approach.” Acm Transactions on Architecture and Code Optimization 11 (3): 283–308.
APA
Eyerman, S., Michaud, P., & Rogiest, W. (2014). Multiprogram throughput metrics: a systematic approach. ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 11(3), 283–308.
Vancouver
1.
Eyerman S, Michaud P, Rogiest W. Multiprogram throughput metrics: a systematic approach. ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION. 2014;11(3):283–308.
MLA
Eyerman, Stijn, Pierre Michaud, and Wouter Rogiest. “Multiprogram Throughput Metrics: a Systematic Approach.” ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION 11.3 (2014): 283–308. Print.
@article{5823474,
  abstract     = {Running multiple programs on a processor aims at increasing the throughput of that processor. However, defining meaningful throughput metrics in a simulation environment is not as straightforward as reporting execution time. This has led to an ongoing debate on what forms a meaningful throughput metric for multiprogram workloads. We present a method to construct throughput metrics in a systematic way: we start by expressing assumptions on job size, job distribution, scheduling, and so forth that together define a theoretical throughput experiment. The throughput metric is then the average throughput of this experiment. Different assumptions lead to different metrics, so one should be aware of these assumptions when making conclusions based on results using a specific metric.
Throughput metrics should always be defined from explicit assumptions, because this leads to a better understanding of the implications and limits of the results obtained with that metric. We elaborate multiple metrics based on different assumptions. In particular, we identify the assumptions that lead to the commonly used weighted speedup and harmonic mean of speedups. Our study clarifies that they are actual throughput metrics, which was recently questioned. We also propose some new throughput metrics, which cannot always be expressed as a closed formula. We use real experimental data to characterize metrics and show how they relate to each other.},
  articleno    = {34},
  author       = {Eyerman, Stijn and Michaud, Pierre and Rogiest, Wouter},
  issn         = {1544-3566},
  journal      = {ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION},
  language     = {eng},
  number       = {3},
  pages        = {34:283--34:308},
  title        = {Multiprogram throughput metrics: a systematic approach},
  url          = {http://dx.doi.org/10.1145/2663346},
  volume       = {11},
  year         = {2014},
}

Altmetric
View in Altmetric
Web of Science
Times cited: