Recent #AI Cluster news in the semiconductor industry

6 months ago

➀ Panmnesia showcased the first AI cluster supporting CXL at the 2024 OCP Global Summit;

➁ The cluster utilizes CXL 3.1 switches to accelerate AI applications like ChatGPT;

➂ CXL technology provides a new method to expand memory without additional server components;

➃ Panmnesia's CXL solutions include CXL IP and CXL switches, enhancing memory and interconnectivity;

➄ The AI cluster includes CXL-Memory nodes and CXL-GPU nodes for memory and AI model acceleration;

➅ The cluster demonstrated the first RAG acceleration on a CXL-enabled AI cluster at the OCP Summit.

AI Cluster
7 months ago

➀ Large cluster scale;

➁ High computing density;

➂ Large-scale deployment of cold plate liquid cooling;

➃ Network card and Roce networking solution;

➄ Switch model and specifications;

➅ Modular maintenance of GPU servers;

➆ Cabinet color indicator lights;

➇ The need for general-purpose servers;

➈ Importance of storage systems;

➍ Power supply guarantee system;

➎ Ongoing expansion of cluster scale.

AI ClusterLiquid CoolingNetworking
9 months ago
➀ The article discusses the evolution of large models from billion-parameter language models to trillion-parameter multimodal models, necessitating a significant boost in underlying computing capabilities for ultra-thousand-card clusters. ➁ It describes the network architecture of ByteDance, Baidu, Alibaba, and Tencent's AI clusters, highlighting the use of advanced technologies like Broadcom Tomahawk 5 chips, InfiniBand, and RoCE. ➂ The article also delves into the innovative HPN-AIPod architecture of Baidu and Alibaba's HPN7 network, showcasing their high-performance and scalable designs.
AI ClusterInfiniBandNetwork ArchitectureRoCE