Protocol

MPI

Message Passing Interface

Lab ready Full lab

Message Passing Interface — portable parallel messaging with point-to-point and collective operations across ranks. Implementations map to verbs, TCP, shared memory, or vendor fabrics under a common API. Still foundational for HPC and many hybrid MPI+X AI workflows.

Domains

Tags

hpccollectivesranksparallel

Sources

  • MPI Forum standards (MPI-3/4)

Related protocols

NCCL

Lab ready

NVIDIA Collective Communications Library implementing allreduce, broadcast, and related GPU collectives over NVLink, PCIe, and RDMA. Topo…

ai

RDMA Verbs

Lab ready

Kernel-bypass networking model: queue pairs, memory regions, and work requests move data between registered buffers with minimal CPU. Com…

aistorage

SHARP

Lab ready

Scalable Hierarchical Aggregation and Reduction Protocol — Mellanox/NVIDIA in-network aggregation for MPI/NCCL collectives on InfiniBand …

ai