Performance Analysis, Design Considerations, and Applications of Extreme-Scale In Situ Infrastructures
SessionState-of-the-Practice: System Characterization and Design
Session ChairTina Butler
Authors
Event Type
Paper
Intermediate
Performance
State of the Practice
TimeThursday, November 17th4pm - 4:30pm
Location355-D
DescriptionA key trend facing extreme-scale computational science is the widening gap between computational and I/O rates, and the challenge that follows is how to best gain insight from simulation data when it is increasingly impractical to save it to persistent storage for subsequent visual exploration and analysis. One approach to this challenge is centered around the idea of in situ processing, where visualization and analysis processing is performed while data is still resident in memory. We examine key design and performance issues of in situ processing at extreme scale on modern platforms: scalability, overhead, performance measurement and analysis, comparison and contrast with a traditional post hoc approach, and interfacing with simulation codes. We illustrate these principles in practice with studies, conducted on large-scale HPC platforms, that include a miniapplication and multiple science application codes, one of which demonstrates in situ methods in use at greater than 1M-way concurrency.
Download PDF
Paper provided by the IEEE Computer SocietyPaper also available from the ACM Digital Library
Authors
