In this Conversations in the Cloud podcast, Esther Baldwin from Intel describes how the convergence of HPC and AI is driving innovation.
On the topic of HPC & AI converged clusters, there’s a perception that if you want to do AI, you must stand up a separate cluster, which Esther notes is not true. Existing HPC customers can do AI on their existing infrastructure with solutions like HPC & AI converged clusters. However, running three workloads – HPC, AI, analytics – together can be tough, with the main problem being that they all have their own software stack and libraries that are optimized for specific applications. With a shared infrastructure, it can be challenging to run these all at the same time. The queuing system creates difficulties and even the underlying file system is incompatible.
This is where the Intel Select Solutions for AI & HPC come in. Intel Select Solutions help people leverage experience with a pre-configured path to get a faster time to value. Intel Select Solutions for HPC & AI Clusters offers users a quick start for those in the HPC environment wanting to run AI workloads. There are two options for Intel Select Solutions for HPC & AI Clusters – an open source version with Magpie and Slurm and a commercially available version with Univa Grid Engine.