.nasa.gov!eugene
Subject: [l/m 4/6/92] New FAQ scaffold (6/28)..c.be FAQ
Date: 6 Mar 1996 13:25:06 GMT

6.Temporary scaffold of New FAQ material...<this panel>
7.Music to benchmark by
8.Benchmark types
9.Linpack
10.Network Performance
11.NIST source and .orgs
12.Benchmark Environments
13.SLALOM
14
15.12 Ways to Fool the Masses with Benchmarks
16.SPEC
17.Benchmark invalidation methods
18
19.WPI Benchmark
20.Equivalence
21.TPC
22
23.RFC 1242 terminology (network benchmarking)
24
25.Ridiculously short benchmarks
26.Other miscellaneous benchmarks
27
28.References
1.Introduction to FAQ chain and netiquette
2.Benchmarking concepts
3.PERFECT Club/Suite
4
5.Performance Metrics

Terminology
.Evaluation
.Analysis
..Mean Value Analysis
.Measurement
Model
Equivalence
.Languages
.Surrogates

Minimal benchmarks
.Kernels
.Tests
Simulations of benchmarks
Results data base
Source code
.Version control
Reduciability
Representativeness
.Functionality, how do you know it works? (correctness)
Testing

Workloads.

Output
.Analysis
.Interpretation
.Statistics, Composites, Averages, means, variance,
..Normalized numbers
.Graphics

Who
Virtual work
Application characterization

Kinds of benchmarkers
People who have to take numbers by faith.
People who reproduce but do so blindly.
People with the time and energy to do so.

                   ^ A  
                s / \ r                
               m /   \ c              
              h /     \ h            
             t /       \ i          
            i /         \ t        
           r /           \ e      
          o /             \ c    
         g /               \ t  
        l /                 \ u
       A /                   \ r
        <_____________________> e   
                Language
 
