The AVIDD-B and AVIDD-I Clusters
Performance Benchmarks
Benchmarks of each of the AVIDD-B and AVIDD-I clusters using their Myrinet interconnect were run on April 10 and April 15, 2003. During April 19 - May 2, 2003, Force10 network switches providing Gigabit ethernet connectivity to each AVIDD-B and AVIDD-I node and dual 10 Gigabit Ethernet pipelines between the two clusters were installed for evaluation purposes. Additional benchmarks were run using this network.
For these benchmarks, the HPL (High Performance LINPACK) package, version 1.0, produced by University of Tennessee, was used. HPL is a software package that solves a random dense linear system in double precision (64 bits) arithmetic on distributed-memory computers. It is a portable and freely available implementation of the High Performance Computing Linpack Benchmark.
| Total GFLOPS | MFLOPS per CPU | % of Peak Theoretical Capacity | Number of CPUS | Total RAM | Interconnect & version | MPI Implementation | Transport | Kernel | Date | Location |
|---|---|---|---|---|---|---|---|---|---|---|
| 682.6 | 3.28 | 68.4 | 208 | 260 | Myrinet GM 1.6.3 |
MPICH-GM 1.2.4..8 | GM | 2.4.18-18.7 | 10-Mar-2003 | Blooomington, IN |
| 682.5 | 3.28 | 68.4 | 208 | 260 | Myrinet GM 1.6.3 |
MPICH-GM 1.2.4..8 | GM | 2.4.18-27.7 | 15-Apr-2003 | Indianapolis, IN |
| 614.4 | 3.20 | 66.7 | 192 | 240 | Myrinet GM 1.6.3 |
MPICH-GM 1.2.4..8 | GM | 2.4.18-18.7 | 9-Mar-2003 | Bloomington, IN |
| 575.0 | 2.99 | 62.4 | 192 | 240 | Force10 FTOS v4.3.2.0b |
LAM 6.6b2 | IP | 2.4.18-27.7 | 21-Apr-2003 | Bloomington, IN |
| 580.8 | 3.03 | 63.0 | 192 | 240 | Force10 FTOS v4.3.2.0b |
LAM 6.6b2 | IP | 2.4.18-27.7 | 19-Apr-2003 | Indianapolis, IN and Bloomington, IN |
| 1,058 | 2.76 | 57.4 | 384 | 480 | Force10 FTOS v4.3.2.0b |
LAM 6.6b2 | IP | 2.4.18-27.7 | 30-Apr-2003 | Indianapolis, IN and Bloomington, IN |
The Myrinet interconnect consists of an M3-E128 chassis populated with 14 M3-SW16-8F 8-port fiber modules connecting to the M3F-PCI64C-2 version "C" PCI cards.
The Force10 interconnect consists of an E600 chassis with five (5) LC-EC-1GE-24S 24-port 100/1000 BaseT line cards and one (1) LC-EE-10GEL-2Z 2-port 10-Gigabit Ethernet LAN-Phy line card. One Force10 switch is installed on the Indianapolis campus and Bloomington campus and the two switches are connected together using the State of Indiana's I-Light infrastructure. The distance between the IUB and IUPUI campuses is approximately 52 miles (84 km).
