Unleash software-accelerated AI inference with Neural Magic on HPE ProLiant Gen11 servers powered by 4th Gen AMD EPYC processors
Unleash software-accelerated AI inference with Neural Magic on HPE ProLiant Gen11 servers powered by 4th Gen AMD EPYC processors
6 PagesHPE ProLiant Gen11 servers with 4th Gen AMD EPYC processors and Neural Magic software deliver high-performance AI inference without GPUs. By combining pruned and quantized models like oBERT-Base and YOLO v5s with next-gen CPUs, they achieve up to 9.19x faster processing than dense models. This solution boosts flexibility, lowers costs, and simplifies deployment at scale. Benefits include 25% power savings, 43% less rack space, and advanced security. Businesses can run AI workloads anywhere, with centralized management and cloud-based updates via HPE GreenLake, driving faster insights and operational efficiency.
