You are here: Foswiki>AGLT2 Web>HepSpecResults (13 Sep 2017, BobBall)EditAttach

HS06 Measurements Performed at AGLT2

We have made a variety of measurements at AGLT2 during September of 2009 in preparation for the upcoming purchase cycle. We present these here in table form. A pdf plot of these November, 2009 data is attached at the bottom of this page.

The usatlas compilation of all results is at http://www.usatlas.bnl.gov/twiki/bin/view/Admins/HepSpecBenchmarks.html

Some results at BNL are at https://web.racf.bnl.gov/Facility/LinuxFarm/specint/HEPSPEC/

July, 2013 (and later), 32-bit, SL6.4

These results include HS06 benchmarks run at other, indicated sites

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread Site OS RL
dc2-6-10/PE1950 X5355 2.66GHz   16GB 667 65.7 8 8 8.21 AGLT2 SL6.4
bl-8-1/M600 E5440 2.83GHz   16GB 667 74.05 8 8 9.26 AGLT2 SL6.4
bl-3-15/M610 E5520 2.27GHz HT on 24GB 1066 118.06 16 12 9.84 AGLT2 SL6.4
110 X5550 2.67GHz   16GB 1333 110.0 8 8 13.75 BNL SL6
118 X5560 2.80GHz   16GB 1333 118.0 8 8 14.75 BNL SL6
202 X5650 2.67GHz HT on 48GB 1333 202.1 24 24 8.42 BNL SL6
c-119-16/R410 X5650 2.67GHz HT on 48GB 1333 207.21 24 24 8.63 AGLT2 SL6.4
taub108/HP-SL390G7 X5650 2.67GHz HT on 48GB 1333 203.67 24 24 8.49 MWT2(UIUC) RHEL6.3
taub116/HP-SL390G7 X5650 2.67GHz HT on 48GB 1333 211.03 24 24 8.79 MWT2(UIUC) RHEL6.3
taub Avg16/HP-SL390G7 X5650 2.67GHz HT on 48GB 1333 206.59 24 24 8.61 MWT2(UIUC) RHEL6.3
205 X5660 2.80GHz HT on 48GB 1333 205.0 24 24 8.54 BNL SL6
uct2-c299/Dell R410 X5660 2.80GHz HT on 48GB 1333 210.05 24 24 8.75 MWT2(UC) SL6.4
uct2-c298/Dell R410 X5660 2.80GHz HT on 48GB 1333 215.17 24 24 8.97 MWT2(UC) SL6.4
uct2 Avg6/Dell R410 X5660 2.80GHz HT on 48GB 1333 212.71 24 24 8.86 MWT2(UC) SL6.4
bl-5-10/M610 X5660 2.80GHz HT on 48GB 1333 214.56 24 24 8.94 AGLT2 SL6.4
bl-5-2/M610 X5670 2.93GHz HT on 48GB 1333 220.61 24 24 9.19 AGLT2 SL6.4
Various dc40-3/Dell R630 E5-2640v4 2.40GHz HT on 128GB 2133 435.7 40 40 10.89 AGLT2 SL6.7
c284/R620 E5-2650 2.00GHz HT on 32GB 1333 227.53 32 16 14.22 Oscer SL6
c081/R620 E5-2650 2.00GHz HT on 32GB 1333 287.83 32 32 9.00 Oscer SL6
lucille-2-2/R620 E5-2650 2.00GHz HT on 126GB 1600 291.25 32 32 9.10 LU CentOS 6.3
Various/Dell R620 E5-2650v2 2.6GHz HT on 96GB 1600 336.47 32 32 10.51 AGLT2 SL6.4
Various/Dell R620 E5-2650v2 2.6GHz HT off 96GB 1600 297.17 16 16 17.45 AGLT2 SL6.4
Various/Dell R620 E5-2650v2 2.6GHz HT on 96GB 1866 348.35 32 32 10.89 AGLT2 SL6.4
Various/Dell M620 E5-2650v2 2.6GHz HT on 96GB 1866 348.80 32 32 10.90 AGLT2 SL6.4
umt3cadence/Dell R720 E5-2650v2 2.6GHz HT on 96GB 1600 321.55 32 32 10.05 AGLT2 SL6.4
bl-6-14/M620 E5-2665 2.40GHz HT on 96GB 1600 314.14 32 32 9.82 AGLT2 SL6.4
golub021/Dell-C8220 E5-2670 2.60GHz HT on 64GB 1600 311.89 32 32 9.75 MWT2(UIUC) RHEL6.3
golub020/Dell-C8220 E5-2670 2.60GHz HT on 64GB 1600 322.23 32 32 10.07 MWT2(UIUC) RHEL6.3
golub Avg16/Dell-C8220 E5-2670 2.60GHz HT on 64GB 1600 316.89 32 32 9.90 MWT2(UIUC) RHEL6.3
4x dc40-16/Dell R620 E5-2670v2 2.50GHz HT on 256GB 1600 426.31 40 40 10.66 AGLT2 SL6.4
c-104-2/Dell R630 E5-2670v3 2.30GHz HT on 256GB 2133 509.21 48 48 10.61 AGLT2 SL6.7
5x dc48-16/Dell R630 E5-2680v3 2.50GHz HT on 128GB 2133 528.29 48 48 11.01 AGLT2 SL6.6
3x dc48-16/Dell R630 E5-2680v3 2.50GHz HT on 256GB 2133 528.34 48 48 11.01 AGLT2 SL6.6
dc48-16/Dell R630 E5-2680v3 2.50GHz HT on 192GB 2133 481.6 48 48 10.03 AGLT2 SL6.6

August, 2017, 32-bit, at Dell Innovation Lab

All these results except for the full-core-count summaries have been moved to page DellInnovationLabResults

Machine/Model ChipSet Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06 /Thread Site OS RL
node001/Dell R730 E5-2680v4 2.40GHz HT off 256GB 2400 505.36 28 28 18.04 Dell/BB RHEL6.8
node002/Dell R630 E5-2699v4 2.20GHz HT off 256GB 2400 776.02 44 44 17.63 Dell/BB RHEL6.8
node003/Dell R630 E5-2697v4 2.30GHz HT off 256GB 2400 638.09 36 36 17.72 Dell/BB RHEL6.8
node004/Dell R630 E5-2697v4 2.30GHz HT off 256GB 2400 646.43 36 36 17.96 Dell/BB RHEL6.8
node020/Dell R640 SkyLake 6136 3.00GHz HT off 384GB 2666 525.57 24 24 21.90 Dell/BB RHEL7.3
node021/Dell R640 SkyLake 6148 2.40GHz HT off 192GB 2666 750.82 40 40 18.77 Dell/BB RHEL7.3
node026/Dell R740 SkyLake 8168 2.70GHz HT off 384GB 2400 957.30 48 48 19.94 Dell/BB RHEL7.3
node027/Dell R640 SkyLake 6134 3.20GHz HT off 192GB 2666 367.92 16 16 23.00 Dell/BB RHEL7.3
node001/Dell R730 E5-2680v4 2.40GHz HT on 256GB 2400 636.43 56 56 11.36 Dell/BB RHEL6.8
node002/Dell R630 E5-2699v4 2.20GHz HT on 256GB 2400 908.16 88 88 10.32 Dell/BB RHEL6.8
node003/Dell R630 E5-2697v4 2.30GHz HT on 256GB 2400 771.71 72 72 10.72 Dell/BB RHEL6.8
node004/Dell R630 E5-2697v4 2.30GHz HT on 256GB 2400 776.65 72 72 10.79 Dell/BB RHEL6.8
node020/Dell R640 SkyLake 6136 3.00GHz HT on 384GB 2666 675.83 48 48 14.08 Dell/BB RHEL7.3
node021/Dell R640 SkyLake 6148 2.40GHz HT on 192GB 2666 936.27 80 80 11.70 Dell/BB RHEL7.3
node026/Dell R740 SkyLake 8168 2.70GHz HT on 384GB 2400 1184.29 96 96 12.34 Dell/BB RHEL7.3
node027/Dell R640 SkyLake 6134 3.20GHz HT on 192GB 2666 471.51 32 32 14.73 Dell/BB RHEL7.3

July, 2013 (and later), 64-bit, SL6.4

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread Site OS RL
dc2-6-10/PE1950 X5355 2.66GHz   16GB 667 66.1 8 8 8.26 AGLT2 SL6.4
bl-8-1/M600 E5440 2.83GHz   16GB 667 76.12 8 8 9.52 AGLT2 SL6.4
bl-3-15/M610 E5520 2.27GHz HT on 24GB 1066 138.37 16 12 11.53 AGLT2 SL6.4
c-119-16/R410 X5650 2.67GHz HT on 48GB 1333 226.53 24 24 9.44 AGLT2 SL6.4
bl-5-10/M610 X5660 2.80GHz HT on 48GB 1333 238.78 24 24 9.95 AGLT2 SL6.4
bl-5-2/M610 X5670 2.93GHz HT on 48GB 1333 244.19 24 24 10.17 AGLT2 SL6.4
Various dc40-3/Dell R630 E5-2640v4 2.40GHz HT on 128GB 2133 511.67 40 40 12.79 AGLT2 SL6.7
lucille-2-2/R620 E5-2650 2.00GHz HT on 126GB 1600 334.81 32 32 10.46 LU CentOS 6.3
Various/Dell R620 E5-2650v2 2.6GHz HT on 96GB 1600 381.93 32 32 11.94 AGLT2 SL6.4
Various/Dell R620 E5-2650v2 2.6GHz HT off 96GB 1600 314.48 16 16 19.66 AGLT2 SL6.4
c-7-16/Dell R620 E5-2650v2 2.6GHz HT on 96GB 1866 396.20 32 32 12.38 AGLT2 SL6.4
bl-11-8/Dell M620 E5-2650v2 2.6GHz HT on 96GB 1866 396.72 32 32 12.40 AGLT2 SL6.4
bl-6-14/M620 E5-2665 2.40GHz HT on 96GB 1600 369.93 32 32 11.56 AGLT2 SL6.4
4x dc40-16/Dell R620 E5-2670v2 2.50GHz HT on 256GB 1600 483.20 40 40 12.08 AGLT2 SL6.4
c-104-2/Dell R630 E5-2670v3 2.30GHz HT on 256GB 2133 597.63 48 48 12.45 AGLT2 SL6.7
4x dc48-16/Dell R630 E5-2680v3 2.50GHz HT on 128/256GB 2133 609.00 48 48 12.69 AGLT2 SL6.6

August, 2017, 64-bit, at Dell Innovation Lab

Machine/Model ChipSet Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06 /Thread Site OS RL
node001/Dell R730 E5-2680v4 2.40GHz HT off 256GB 2400 603.80 28 28 21.56 Dell/BB SL6.8
node002/Dell R630 E5-2699v4 2.20GHz HT off 256GB 2400 880.60 44 44 20.01 Dell/BB SL6.8
node003/Dell R630 E5-2697v4 2.30GHz HT off 256GB 2400 754.05 36 36 20.95 Dell/BB SL6.8
node004/Dell R630 E5-2697v4 2.30GHz HT off 256GB 2400 761.38 36 36 21.15 Dell/BB SL6.8
node020/Dell R640 SkyLake 6136 3.00GHz HT off 384GB 2666 615.77 24 24 25.66 Dell/BB RHEL7.3
node021/Dell R640 SkyLake 6148 2.40GHz HT off 192GB 2666 873.07 40 40 21.83 Dell/BB RHEL7.3
node026/Dell R740 SkyLake 8168 2.70GHz HT off 384GB 2400 1104.20 48 48 23.00 Dell/BB RHEL7.3
node027/Dell R640 SkyLake 6134 3.20GHz HT off 192GB 2666 430.17 16 16 26.89 Dell/BB RHEL7.3
node001/Dell R730 E5-2680v4 2.40GHz HT on 256GB 2400 722.59 56 56 12.90 Dell/BB SL6.8
node002/Dell R630 E5-2699v4 2.20GHz HT on 256GB 2400 996.44 88 88 11.32 Dell/BB SL6.8
node003/Dell R630 E5-2697v4 2.30GHz HT on 256GB 2400 885.92 72 72 12.30 Dell/BB SL6.8
node004/Dell R630 E5-2697v4 2.30GHz HT on 256GB 2400 889.16 72 72 12.35 Dell/BB SL6.8
node020/Dell R640 SkyLake 6136 3.00GHz HT on 384GB 2400 784.60 48 48 16.35 Dell/BB RHEL7.3
node021/Dell R640 SkyLake 6148 2.40GHz HT on 192GB 2400 1067.82 80 80 13.35 Dell/BB RHEL7.3
node026/Dell R740 SkyLake 8168 2.70GHz HT on 384GB 2400 1350.15 96 96 14.06 Dell/BB RHEL7.3
node027/Dell R640 SkyLake 6134 3.20GHz HT on 192GB 2400 554.72 32 32 17.34 Dell/BB RHEL7.3

Apr 2013

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread
c4-11-2/C6100 X5560 2.80GHz HT off 36GB 1333 111.38 8 8 13.92
c4-11-2/C6100 X5560 2.80GHz HT on 36GB 1333 141.66 16 16 8.85

Nov 2012

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread
bl-6-14/M620 E5-2665 2.40GHz HT on 96GB 1600 294.03 32 32 9.19
bl-6-14/M620 E5-2665 2.40GHz HT on 96GB 1600 289.70 32 24 12.07
bl-6-14/M620 E5-2665 2.40GHz HT on 96GB 1600 245.76 32 16 15.36
bl-6-14/M620 E5-2665 2.40GHz HT off 96GB 1600 242.67 16 16 15.07
bl-5-16/M610 X5660 2.80GHz HT on 48GB 1333 200.74 24 24 8.36

May 2012

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread
c-14-17/R720 E5-2440 2.40GHz HT on 24GB 1333 224.62 24 24 9.35
c-14-17/R720 E5-2440 2.40GHz HT on 24GB 1333 212.92 24 18 11.82
c-14-17/R720 E5-2440 2.40GHz HT on 24GB 1333 181.45 24 12 15.12
c-14-17/R720 E5-2440 2.40GHz HT off 24GB 1333 178.9 12 12 14.91

October/November 2010 Measurements

Machine/Model Xeon Speed BIOS Settings RAM Speed HS06 Total Cores Threads HS06/thread
tera05/R710 X5650 2.67GHz CPU prio = I/O 24GB 1333 165.20 12 12 13.77
tera04/R710 X5650 2.67GHz CPU prio = compute / HT on 24GB 1333 199.31 24 24 8.31
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 213.20 24 36 5.92
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 217.87 24 32 6.81
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 218.06 24 28 7.79
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 213.26 24 27 7.90
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 208.86 24 26 8.03
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 204.98 24 25 8.20
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 199.51 24 24 8.31
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 198.68 24 24 8.28
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 203.21 24 23 8.84
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 203.58 24 22 9.25
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 204.50 24 21 9.74
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 202.63 24 20 10.13
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 196.24 24 19 10.33
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 193.62 24 18 10.76
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 187.77 24 16 11.74
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 164.68 24 12 13.72
c-104-41/R610 X5650 2.67GHz HT on 48GB 1333 118.58 24 8 14.82
c-104-42/R610 X5650 2.67GHz HT on 48GB 1333 64.35 24 4 16.09
c-104-42/R610 X5650 2.67GHz HT off 48GB 1333 174.53 12 16 10.91
c-104-42/R610 X5650 2.67GHz HT off 48GB 1333 164.14 12 12 13.68
c-104-41/R610 X5650 2.67GHz HT off 48GB 1333 118.63 12 8 14.83
c-104-40/R410 X5650 2.67GHz HT on 48GB 1333 196.04 24 24 8.17
c-104-40/R410 X5650 2.67GHz HT on 48GB 1333 199.40 24 20 9.97
c-110-xx/R410 X5650 2.67GHz HT on 48GB 1333 199.22 24 24 8.30
bl-5-1/M610 X5670 2.93GHz HT on 48GB 1333 215.23 24 24 8.97
bl-5-1/M610 X5670 2.93GHz HT on 48GB 1333 210.73 24 20 10.54
bl-5-1/M610 X5670 2.93GHz HT on 48GB 1333 200.74 24 16 12.55

April 2010 64-bit Measurements

Machine CPU(+) Speed HT on Threads RAM Speed HS06 Total HS06/core HS06 32bit Total 64bit/32bit
dc2-3-16 X5355 2.66GHz NA 8 16GB 667 64.77 8.10 59.6 1.09
sx-11-28 AMD 8220 2.80GHz NA 16 32GB 333 113.09 7.07 118.06* 0.96
bl-11-1 X5560 2.80GHz yes 6 12GB 1333 109.85 18.31 86.54* 1.27
bl-11-3 X5560 2.80GHz yes 12 12GB 1333 154.56 12.88 132.02* 1.17
bl-11-2 X5560 2.80GHz yes 16 12GB 1333 164.15 10.26 139.36* 1.18
bl-8-7 E5440 2.83GHz NA 8 16GB 667 74.15 9.27 74.07 1.00
bl-13-7 E5440 2.83GHz NA 8 16GB 667 73.65 9.21 72.56 1.02
cc-117-12 E5520 2.27GHz yes 12 24GB 1066 134.70 11.23 113.9* 1.18
bl-1-11 E5520 2.27GHz yes 8 24GB 1066 114.02 14.26 95.55 1.19
bl-1-11 E5520 2.27GHz yes 12 24GB 1066 132.64 11.05 115.17 1.15
bl-1-11 E5520 2.27GHz yes 16 24GB 1066 143.09 8.94 120.57 1.19
Note +: CPU is Intel unless noted
Note *: Using November result for similar configuration

December 2009 Measurements

Machine Xeon Speed HT on Threads RAM Speed HS06 Total HS06/core Typical load_one
bl-11-2 X5560 2.80GHz yes 6 12GB 1333 86.54 14.42 6.0
bl-11-2 X5560 2.80GHz yes 8 12GB 1333 110.63 13.83 8.0
bl-11-2 X5560 2.80GHz yes 10 12GB 1333 122.83 12.28 10.0
bl-11-2 X5560 2.80GHz yes 12 12GB 1333 132.02 11.00 12.0
bl-11-2 X5560 2.80GHz yes 16 12GB 1333 139.36 8.52 17.0
                   
sx-11-28 AMD 8220 2.80GHz no 16 32GB ??? 118.06 7.38 16.0

November 2009 Measurements

Machine Xeon Speed HT on Threads RAM Speed HS06 Total HS06/core Typical load_one
bl-1-6 E5520 2.27GHz no 4 24GB 1066 52.94 13.24 4.0
bl-1-7 E5520 2.27GHz no 6 24GB 1066 75.27 12.55 6.0
bl-1-2 E5520 2.27GHz no 8 24GB 1066 95.73 11.97 9.0
bl-1-1 E5520 2.27GHz no 10 24GB 1066 100.18 10.02 11.0
bl-1-8 E5520 2.27GHz no 12 24GB 1066 100.19 8.35 13.0
bl-1-4 E5520 2.27GHz yes 4 24GB 1066 52.61 13.15 4.0
bl-1-5 E5520 2.27GHz yes 6 24GB 1066 74.92 12.49 6.0
bl-1-1 E5520 2.27GHz yes 8 24GB 1066 95.38 11.92 8.0
bl-1-2 E5520 2.27GHz yes 10 24GB 1066 107.67 10.77 10.0
bl-1-1 E5520 2.27GHz yes 12 24GB 1066 113.87 9.49 12.0
bl-1-1 E5520 2.27GHz yes 12 24GB 1066 113.91 9.49 12.0
bl-1-3 E5520 2.27GHz yes 14 24GB 1066 118.85 8.49 14.0
bl-1-2 E5520 2.27GHz yes 16 24GB 1066 121.43 7.59 17.0
bl-1-2 E5520 2.27GHz yes 18 24GB 1066 118.96 6.61 19.0
bl-1-3 E5520 2.27GHz yes 20 24GB 1066 125.04 6.25 21.0

Reruns of older node types at SLC4.8, now with SL5.3
Machine Xeon Speed HT on Threads RAM Speed HS06 Total HS06/core Typical load_one
dc-1-28 X5355 2.66GHz NA 8 16GB ?? 64.60 8.07 9.0

September 2009 Measurements

Machine Xeon Speed HT on Threads RAM Speed HS06 Total HS06/core
sbl-11-1 X5570 2.93GHz yes 8 24GB 1333 98.14 12.27
sbl-11-1 X5570 2.93GHz no 8 24GB 1333 120.04 15.01
sbl-11-1 X5570 2.93GHz yes 8 24GB 1333 97.67 12.21
sbl-11-1 X5570 2.93GHz yes 16 24GB 1333 156.19 9.76
sbl-11-1 X5570 2.93GHz yes 12 24GB 1333 147.99 12.33
sbl-11-1 X5570 2.93GHz no 12 24GB 1333 125.46 10.46
sbl-11-1 X5570 2.93GHz yes 12 20GB 1066 143.29 11.94
sbl-11-1 X5570 2.93GHz yes 16 20GB 1066 152.07 9.50
                   
sbl-11-11 L5520 2.27GHz yes 16 24GB 1066 118.53 7.41

We note that with Hyper Threading ON we get the best total machine performance, and that total performance is nearly sustained whether we run 12 threads or 16 threads on the 16 cores that present this way.

We also note that with Hyper Threading ON we cannot run 16 production threads in this configuration as that results in less than 2GB of RAM per core.

Using 1066MHz RAM results in an approximately 3% performance hit vs the 1333 RAM.

May 2009 Measurements

Processor Speed Threads RAM Speed HS06 Total HS06/core
Intel X5355 2.66GHz 8 16GB   59.6 7.45
Intel E5440 2.83GHz 8 16GB   68.4 8.55
Intel E5345 2.33GHz 8 16GB   55.9 6.99
AMD 285 2.6GHz 4 8GB   30.0 7.51
-- BobBall - 18 Sep 2009
Topic attachments
I Attachment Action Size Date Who Comment
HS06_Core_Plots2.pdfpdf HS06_Core_Plots2.pdf manage 64.0 K 18 Nov 2009 - 19:12 BobBall Plots of HS06 performance vs number of simultaneous measurement threads
Topic revision: r70 - 13 Sep 2017 - 20:39:05 - BobBall
 

This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback