Hybrid MPI+UPC parallel programming paradigm on an SMP cluster

Zeki BOZKUŞ

Makale detayları

Hybrid MPI+UPC parallel programming paradigm on an SMP cluster

Yazarlar:

Zeki BOZKUŞ

Yayıncı:

TUBITAK

Dergi:

Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1389-1407

Belge Tipi:

Makale

Yayın Tarihi:

11/2011

Belge Dili:

Türkçe

Document ID (Org No.):

2000743704

Sıklık:

İki Aylık

eISSN:

1303-6203

pISSN:

1300-0632

Özet:

 

The symmetric multiprocessing (SMP) cluster system, which  consists of shared memory nodes with several multicore central  processing units connected to a high-speed network to form a  distributed memory system, is the most widely available hardware  architecture for the high-performance computing community.  Today, the Message Passing Interface (MPI) is the most widely used parallel  programming paradigm for SMP clusters, in which the MPI provides  programming both for an SMP node and among nodes simultaneously.  However, Unified Parallel C (UPC) is an emerging alternative that  supports the partitioned global address space model that can be again  employed within and across the nodes of a cluster.  In this paper, we describe a hybrid parallel programming paradigm that was designed to combine MPI and UPC programming models.  This  paradigm's objective is to mix the MPI's data locality control and  scalability strengths with UPC's fine-grain parallelism and ease of  programming to achieve multiple-level parallelism at the SMP cluster,  which itself has multilevel parallel architecture.  Utilizing a  proposed hybrid model and comparing MPI-only to UPC-only  implementations, this paper presents a detailed description of  Cannon's algorithm benchmark application with performance results of a random-access benchmark and the Barnes--Hut N-Body simulation.  Experiments indicate that the hybrid MPI+UPC model can significantly  provide performance increases of up to double in comparison with  UPC-only implementation, and up to 20% increases in comparison to  MPI-only implementation.  Furthermore, an optimization was achieved  that improved the hybrid performance by an additional 20%.

 

The symmetric multiprocessing (SMP) cluster system, which  consists of shared memory nodes with several multicore central  processing units connected to a high-speed network to form a  distributed memory system, is the most widely available hardware  architecture for the high-performance computing community.  Today, the Message Passing Interface (MPI) is the most widely used parallel  programming paradigm for SMP clusters, in which the MPI provides  programming both for an SMP node and among nodes simultaneously.  However, Unified Parallel C (UPC) is an emerging alternative that  supports the partitioned global address space model that can be again  employed within and across the nodes of a cluster.  In this paper, we describe a hybrid parallel programming paradigm that was designed to combine MPI and UPC programming models.  This  paradigm's objective is to mix the MPI's data locality control and  scalability strengths with UPC's fine-grain parallelism and ease of  programming to achieve multiple-level parallelism at the SMP cluster,  which itself has multilevel parallel architecture.  Utilizing a  proposed hybrid model and comparing MPI-only to UPC-only  implementations, this paper presents a detailed description of  Cannon's algorithm benchmark application with performance results of a random-access benchmark and the Barnes--Hut N-Body simulation.  Experiments indicate that the hybrid MPI+UPC model can significantly  provide performance increases of up to double in comparison with  UPC-only implementation, and up to 20% increases in comparison to  MPI-only implementation.  Furthermore, an optimization was achieved  that improved the hybrid performance by an additional 20%.

Makale detayları

Hybrid MPI+UPC parallel programming paradigm on an SMP cluster

Yazarlar: Zeki BOZKUŞ

Yayıncı: TUBITAK

Dergi: Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1389-1407

Belge Tipi: Makale

Yayın Tarihi: 11/2011

Belge Dili: Türkçe

Document ID (Org No.): 2000743704

Sıklık: İki Aylık

eISSN: 1303-6203

pISSN: 1300-0632

Sayı

Yazarlar:

Zeki BOZKUŞ

Yayıncı:

TUBITAK

Dergi:

Turkish Journal of Electrical Engineering and Computer Science 2012 Vol.20 Issue Sup.2, pp.1389-1407

Belge Tipi:

Makale

Yayın Tarihi:

11/2011

Belge Dili:

Türkçe

Document ID (Org No.):

2000743704

Sıklık:

İki Aylık

eISSN:

1303-6203

pISSN:

1300-0632