Publication Details

GPU-accelerated Evolutionary Design of the Complete Exchange Communication on Wormhole Networks

JAROŠ, J.; TYRALA, R. GPU-accelerated Evolutionary Design of the Complete Exchange Communication on Wormhole Networks. In GECCO 2014 - Proceedings of the 2014 Genetic and Evolutionary Computation Conference. New York, NY: Association for Computing Machinery, 2014. p. 1023-1030. ISBN: 978-1-4503-2662-9.
Czech title
Akcelerace evolučního návhru kolektivní komunikace Compelte Echange pomocí GPU
Type
conference paper
Language
English
Authors
Jaroš Jiří, doc. Ing., Ph.D. (DCSY)
Tyrala Radek, Ing.
URL
Keywords

Complete exchange communication, Collective communications, communication scheduling, evolutionary design, GPU-based acceleration, multi-GPU systems.

Abstract

The communication overhead is one of the main challenges in the exascale era, where millions of compute cores are expected to collaborate on solving complex jobs. However, many algorithms will not scale since they require complex global communication and synchronisation. In order to perform the communication as fast as possible, contentions, blocking and deadlock must be avoided. Recently, we have developed an evolutionary tool producing fast and safe communication schedules reaching the lower bound of the theoretical time complexity. Unfortunately, the execution time associated with the evolution process raises up to tens of hours, even when being run on a multi-core processor. In this paper, we propose a revised implementation accelerated by a single Graphic Processing Unit (GPU) delivering speed-up of 5 compared to a quad-core CPU. Subsequently, we introduce an extended version employing up to 8 GPUs in a shared memory environment offering a speed-up of almost 30. This significantly extends the range of interconnection topologies we can cover.

Published
2014
Pages
1023–1030
Proceedings
GECCO 2014 - Proceedings of the 2014 Genetic and Evolutionary Computation Conference
ISBN
978-1-4503-2662-9
Publisher
Association for Computing Machinery
Place
New York, NY
DOI
UT WoS
000364333000128
EID Scopus
BibTeX
@inproceedings{BUT111530,
  author="Jiří {Jaroš} and Radek {Tyrala}",
  title="GPU-accelerated Evolutionary Design of the Complete Exchange Communication on Wormhole Networks",
  booktitle="GECCO 2014 - Proceedings of the 2014 Genetic and Evolutionary Computation Conference",
  year="2014",
  pages="1023--1030",
  publisher="Association for Computing Machinery",
  address="New York, NY",
  doi="10.1145/2576768.2598315",
  isbn="978-1-4503-2662-9",
  url="http://dl.acm.org/citation.cfm?id=2576768.2598315"
}
Back to top