Publications of Torsten Hoefler

Didem Unat, John Shalf, Torsten Hoefler, Thomas Schulthess, Anshu Dubey (Editors), Maciej Besta, and others:

Programming Abstractions for Data Locality

(Technical Report. presented in Lugano, Switzerland, Apr. 2014)

Abstract

The goal of the workshop and this report is to identify common themes and standardize concepts for locality-preserving abstractions for exascale programming models. Current software tools are built on the premise that computing is the most expensive component, we are rapidly moving to an era that computing is cheap and massively parallel while data movement dominates energy and performance costs. In order to respond to exascale systems (the next generation of high performance computing systems), the scientific computing community needs to refactor their applications to align with the emerging data-centric paradigm. Our applications must be evolved to express information about data locality. Unfortunately current programming environments offer few ways to do so. They ignore the incurred cost of communication and simply rely on the hardware cache coherency to virtualize data movement. With the increasing importance of task-level parallelism on future systems, task models have to support constructs that express data locality and affinity. At the system level, communication libraries implicitly assume all the processing elements are equidistant to each other. In order to take advantage of emerging technologies, application developers need a set of programming abstractions to describe data locality for the new computing ecosystem. The new programming paradigm should be more data centric and allow to describe how to decompose and how to layout data in the memory. Fortunately, there are many emerging concepts such as constructs for tiling, data layout, array views, task and thread affinity, and topology aware communication libraries for managing data locality. There is an opportunity to identify commonalities in strategy to enable us to combine the best of these concepts to develop a comprehen- sive approach to expressing and managing data locality on exascale programming systems. These programming model abstractions can expose crucial information about data locality to the compiler and runtime system to en- able performance-portable code. The research question is to identify the right level of abstraction, which includes techniques that range from template libraries all the way to completely new languages to achieve this goal.

Documents

download article:

download attachment:

BibTeX

@techreport{padal-report,
  author={Didem Unat and John Shalf and Torsten Hoefler and Thomas Schulthess and Anshu Dubey (Editors) and Maciej Besta and and others},
  title={{Programming Abstractions for Data Locality}},
  journal={Technical Report},
  year={2014},
  month={Apr.},
  location={Lugano, Switzerland},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 18.191.192.250:56924	© Torsten Hoefler