HTC-Sim: a trace-driven simulation framework for energy consumption in high-throughput computing systems

Forshaw, Matthew; McGough, Andrew Stephen; Thomas, Nigel

Abstract

High-throughput computing (HTC) is a powerful paradigm allowing vast quantities of independent work to be performed simultaneously across many loosely coupled computers. These systems often exploit the idle time available on computers provisioned for other purposes – volunteer computing. However, until recently, little evaluation has been performed on the energy impact of HTC. Many organisations now seek to minimise energy consumption across their IT infrastructure. However, it is unclear how this will affect the usability of HTC systems especially when exploiting volunteer computers. We present here HTC-Sim, a simulation system that allows the evaluation of different energy reduction policies across an HTC system. We model systems that comprised both collections of computational resources dedicated to HTC work and resources provided through volunteer computing – a desktop grid. We demonstrate that our simulation software scales linearly with increasing HTC workload. We go further to evaluate a number of resource selection policies in terms of the overheads/slowdown incurred and the energy impact on the HTC system.

Citation

Forshaw, M., McGough, A. S., & Thomas, N. (2016). HTC-Sim: a trace-driven simulation framework for energy consumption in high-throughput computing systems. Concurrency and Computation: Practice and Experience, 28(12), 3260-3290. https://doi.org/10.1002/cpe.3804

• Journal Article Type: Article
• Acceptance Date: Jan 28, 2016
• Online Publication Date: Mar 19, 2016
• Publication Date: Aug 25, 2016
• Deposit Date: Dec 13, 2015
• Publicly Available Date: Mar 19, 2017
• Journal: Concurrency and Computation: Practice and Experience
• Print ISSN: 1532-0626
• Electronic ISSN: 1532-0634
• Publisher: Wiley
• Peer Reviewed: Peer Reviewed
• Volume: 28
• Issue: 12
• Pages: 3260-3290
• DOI: https://doi.org/10.1002/cpe.3804
• Public URL: https://durham-repository.worktribe.com/output/1393957