#NVIDIA Grace CPU

NVIDIA announced its first data center CPU— the NVIDIA Grace. According to NVIDIA, the NVIDIA Grace is the result of more than 10,000 engineering years of work. The company mentioned that the Grace CPU is designed to address the computing requirements for the world's most advanced applications, including natural language processing, recommender systems, and AI supercomputing. The NVIDIA Grace CPU, named after Grace Hopper, the U.S computer-programming pioneer, will serve a niche segment of computing. “Using licensed Arm IP, NVIDIA has designed Grace as a CPU specifically for giant-scale AI and HPC. NVIDIA is now a three-chip company.” Grace is a specialized processor that targets workloads such as training next-generation NLP models with more than 1 trillion parameters. When paired with NVIDIA GPUs, a Grace CPU-based system will deliver 10x faster performance than NVIDIA DGX based systems which run on x86 CPUs, according to NVIDIA. Underlying Grace's performance is fourth-generation NVIDIA NVLink interconnect technology, which provides a 900 GB/s connection between Grace and NVIDIA GPUs that enables 30x higher aggregate bandwidth compared to today's leading servers. Read more in our articles including "NVIDIA intros Grace CPU for giant AI and high performance computing workloads" and "Nothing Phone (4b) design and chipset revealed".