SC16 Salt Lake City, UT

DS5. Parallel Storage Systems for Large-Scale Machines

Student: Christos Filippidis (National and Kapodistrian University of Athens)
Advisor: Yiannis Cotronis (National and Kapodistrian University of Athens)
Abstract: HPC has crossed the petaflop mark and is reaching the exaflop range quickly. The exascale system is projected to have millions of nodes, with thousands of cores for each node. At such an extreme scale, the substantial amount of concurrency can cause a critical contention issue for I/O system. This study proposes a dynamically coordinated I/O architecture for addressing some of the limitations that current parallel file systems and storage architectures are facing with very large-scale systems. The fundamental idea is to coordinate I/O accesses according to the topology/profile of the infrastructure, the load metrics, and the I/O demands of each application. The measurements have shown that by using IKAROS approach we can fully utilize the provided I/O and network resources, minimize disk and network contention, and achieve better performance.

Summary: pdf
Presentation: pdf
Poster: pdf

Doctoral Showcase Index