Generative AI with Intel AI and Red Hat OpenShift AI Reference Architecture

This document is a comprehensive guide designed to assist organizations in understanding and deploying generative AI solutions using Intel AI and Red Hat OpenShift AI. It outlines the hardware and software requirements necessary for successful implementation of generative AI workloads, specifically focusing on single-node Intel Xeon processors and Intel Gaudi 3 AI accelerators. The guide provides step-by-step deployment instructions and best practices for managing and operating AI workloads effectively. It aims to define a reference architecture for integrating OpenShift AI with Intel hardware, recommend deployment strategies, and explain optimal practices for running common generative AI workloads. The intended audience includes enterprise architects, AI engineers, DevOps professionals, and system integrators, all of whom will benefit from the structured approach to deploying AI systems outlined in this document.