SIAM PP 2024

Baltimore Inner Harbor, 2024

Smart Networks in HPC: For Fun or Profit (or Both)?

Organizers: Richard Vuduc, Georgia Institute of Technology; Jeffrey Young, Georgia Institute of Technology; Hyesoon Kim, Georgia Institute of Technology

This minisymposium asks what new opportunities exist to speed up HPC applications using “smart networks,” i.e., networks with computational processors as part of the network fabric itself. Such infrastructures have existed in HPC historically, but the new trend is to develop and deploy them in massive-scale data centers. Will smart networks for data center workloads benefit HPC, too? By analogy, commercial processors specialized for graphics – i.e., GPUs – became more general-purpose and affordable to deploy in HPC systems. Will a similar economy of scale apply to smart networks, albeit one that accelerates communication rather than computation, as GPUs do?

To help the audience draw a conclusion, the talks cover application case studies, algorithms, libraries and middleware, runtime systems, compilers and programming systems, and hardware. This full-stack view will illuminate the many crosscutting issues at play and allow participants with diverse interests to engage with the topic.

Do Research with SmartNICs

Are you interested to investigate SmartNICs more or use them for your research? Most academic-related researchers can apply to our CRNCH Rogues Gallery testbed, which hosts NVIDIA BlueField 2 and 3 SmartNICs, FPGA-based SmartNICs, and related software like ODOS.

Presenter Slides and Citation

Please see this link to our Figshare with all the speaker presentations.

We hope you find these presentations interesting and useful for your own work. Please cite individual talks using the provided DOI on each FigShare page.

Event Agenda

Tuesday, March 5th; 1:00 PM – 3:00 PM; MS4

SpeakerTalk TitleSpeaker AffiliationCoauthors
Oscar HernandezEmerging Use-Cases of SmartNICs for Scientific ComputingOak Ridge National Laboratory, U.S.
Martin SchulzHow Might Smart Networking Infrastructure Impact HPC Applications?Technische Universität München, GermanyDennis-Florian Herr
Richard GrahamCommunication-Library Offload onto SmartnicsNVIDIA, U.S
Dhabaleswar K. PandaAccelerating HPC and AI Applications by Offloading Computation and Communication to SmartNICsOhio State University, U.S.

Tuesday, March 5th; 3:30 PM – 5:30 PM; MS15

SpeakerTalk TitleSpeaker AffiliationCoauthors
Dingwen TaoLessons Learned from Accelerating Deep Learning Applications Using SmartNICsIndiana University, U.S.(Author was unable to attend)
Tobias WeinzierlIntelligent Algorithms on Intelligent Networks-Experiences and Challenges Using Nvidia’s BlueField Technology [Slides]Durham University, United Kingdom
Weicong ChenAccelerating Lossy and Lossless Compression with BlueField DPUs University of California, Merced, U.S.
Bahar AsgariDynamic Data Reduction in Motion: A Path to Efficient Sparse AI and BeyondUniversity of Maryland, U.S.

Wednesday, March 6th; 3:30 PM – 5:30 PM; MS26

SpeakerTalk TitleSpeaker AffiliationCoauthors
Sara KaramatiSmartNIC-Accelerated Molecular Dynamics and Algebraic Multigrid AlgorithmsGeorgia Institute of Technology, U.S.Jeffrey Young, Richard Vuduc
Antonio J. PeñaODOS: Supporting DPU Offloading with OpenMP DirectivesBarcelona Supercomputing Center, SpainSergio Iserte, Muhammad Usman
Scott LevyOffloading Data Management Services to SmartnicsSandia National Laboratories, U.S.
Ryan GrantAccelerating I/O Services Using SmartnicsQueen’s University, Canada(Author was unable to attend)