42. Hobbes Node Virtualization Layer: System Software Infrastructure for Application Composition and Performance Isolation
Authors: Noah Evans (Sandia National Laboratories)Brian Kocoloski (University of Pittsburgh)John R. Lange (University of Pittsburgh)Kevin Pedretti (Sandia National Laboratories)Shyamali Mukherjee (Sandia National Laboratories)Ron Brightwell (Sandia National Laboratories)Patrick G. Bridges (University of New Mexico)
Abstract: As computation outstrips I/O performance, moving as much of the end-to-end HPC workflow onto individual nodes is a potential solution to solving data movement bottlenecks. However this integration is difficult, most HPC simulations were designed to run in isolation therefore on-node composition potentially breaks many assumptions applications have about scheduling, resource usage, and performance. To address this problem we have developed an MPI runtime and PMI that utilize the Node Virtualization Layer provided by the Hobbes project to enable the composition of applications on-node using MPI. This approach makes it possible to use common MPI intracommunicators as a composition mechanism across heterogeneous operating systems on the same node.
Two-page extended abstract: pdf