I believe that HPC-like infrastructure enables AI at Scale. In this HPC Lab I intend to publish examples of both worlds.
Examples
MPI
HPC Lab 1 – Run an MPI Program with mpiexec
HPC Lab 2 – Getting Started with MPI using a shell script
HPC Lab 3 – Getting Started with MPI using C
HPC Lab 4 – Sending and receiving MPI messages
HPC Lab 5 – Launching MPI applications via a scheduler (LSF)