CHPC Computational Platforms

Transcrição

1 CHPC Computational Platforms Dorah Thobye Acting Technical Manager Slide 1

2 OUTLINE CHPC HPC PLATFORMS IBM IBM E1350 LINUX CLUSTER BLUE GENE/P CHALLENGES MACHINE USAGE STATS SUN MICROSYSTEMS SUN Fusion M9000 VISUALISATION FUTURE PROJECTS

3 E1350 IBM LINUX CLUSTER 160 Nodes Two dual core AMD 2.6GHz processors Each node with 16Gb of DDR2 memory The RPeak value of 2.5TFlop 94TB of shared storage Slide 3

4 BLUE GENE/P 16 IO Nodes 24 compute nodes Each node with 2GB of memory RPeak value of 13.6Teraflops Measured value of 11.5Teraflops 94TB shared storage BG/P Scalable Codes: Slide 4

5 CHALLENGES MAINTENANCE - 3yr warranty STORAGE CAPACITY - Blockage of the file systems, caused by single users creating millions of files. PLAN - Phase approach migration to the Sun Cluster - Code Porting exercise - Backup of the user s programs/codes - Data limitation by means of quotas - $HOME acts as repository for source code, binaries, libraries and applications with small size and I/O demands - $WORK acts as temporary storage location. If the application is able to handle large files is the right file system to place them.

6 e1350 Load Leveller Jobs vs Users Thou sands Jobs Users 2009 Jobs 2008 Jobs 2008 Users 2009 Users Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov 0

7 e1350 Load Leveller Job CPU Time vs Users Millions Job CPU Tim e (seconds) Users s 2009 Job CPU 2008 Job CPU 2008 Users 2009 Users Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov 0

8 BlueGene/P Load Leveller Monthly Jobs vs Users Jobs Users 2009 Jobs 2009 Users Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov 0

9 BlueGene/P Load Leveller Monthly Job CPU vs Users Thousands ime (seconds) Accumulated Job CPU Ti Users 2009 Job CPU 2009 Users Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov 0

10 CHPC-SUN Hybrid Architecture

11 M SMP Solution THE SUN SPARC Enterprise M The M has 16 CPU Memory Boards (CMU) Each CMU contains 4 X 2.52 GHz SPARC64 VII quad core processors Each CMU contains 128GB of memory Total of 64 processors with 2TB of memory The RPeak value of 2TFlop M9000 scalable codes: Slide 11

12 SUN FUSION CLUSTER SUN BLADE 6048 SYSTEM (Hypertown) 1 X C48 rack with 48 X 6250 blades Each with Xeon E5450 Processors Each blade has 16GB RAM(768GB total RAM) The RPeak value of 4TFlops SUN BLADE 6048 with NEHALEM chip 3 X C48 racks with 48 X 6275 blades Each with 4 X 5570 Xeon processors 576 NEHALEM processors Total RAM of 3456 GB Each X 6275 has 2 X 24GB Flash disks The RPeak value of 27TFlops SUN FUSSION measured value 25.4TFlops Slide 12

13 STORAGE Dual Quad-Core AMD Opteron processors 48 intregrated SATA disk drives onboard X 4540 each with 48TB of Storage Total of 480TB of Storage Storage is provided with Lustre as a system Storage is connected to the QDR Infiniband switch Slide 13

14 VISUALIZATION Slide 14

15 VISUALIZATION (cont ) SUN visualization software includes ParaView,Open Scene Graph and Chromium Shared software provide VirtualGL,Virtual Network Computing(TurboVNC) and Sun N1Grid Engine High-performance graphics accelerator NVIDIA Quadro Plex Sun Fire X4600 server NVIDIA Quadro Plex Solution NVIDIA Quadro Card Slide 15

16 FUTURE PROJECTS GPU CLUSTER Rpeak of 14.9 TF SP and 1.23 TF DP with 16 x C60s or; Rpeak of 16.5 TF with 4 x S70-500s. MOAB CLUSTER SUITE CHPC has formed a partnership with Adaptive Computing Objective of the collaboration is to implement a centralised platform that will govern resources within the entire CHPC computational infrastructure Moab Cluster suite will be integrated into the existing scheduling systems in order to improve management of the resources TOTALVIEW Debugging and optimizing tool for the scientific software application Trial version of Totalview application has been installed on the IBM E1350 Cluster Ready for testing

17 THANK YOU