➀ NVIDIA showcased its new PCIe form factor GPU, the H200 NVL, at OCP Summit 2024; ➁ The H200 NVL features a 4-way NVLink bridge between GPUs, offering lower power consumption and cost; ➂ The H200 NVL solution is designed for inference workloads, providing a formidable 564GB of HBM across four cards.
Recent #server news in the semiconductor industry
➀ Lenovo showcases a new server, the ThinkSystem SR860 V3, with 128x 128GB DDR5 DIMMs and CXL memory technology; ➁ The server leverages Astera Labs Leo CXL controllers to achieve massive memory capacity; ➂ The system supports up to 16TB of memory and can accommodate four double-width GPUs.
1. Super Micro Computer reported mixed Q1/FY2025 results with weaker-than-expected sales; 2. Improved margins and decent cash generation helped offset the sales shortfall; 3. Disappointing second quarter guidance with sales and EPS below consensus expectations; 4. Weak sales outlook attributed to limited availability of Nvidia's next-generation GPUs; 5. Stock upgraded to 'Hold' despite nearly 50% decline from initial 'Sell' recommendation.
➀ Supermicro showcases its next-generation 4U AI platform, the SYS-422GA-NBRT-LCC, at OCP 2024. The platform features liquid cooling, PCIe switches integration, and improved serviceability. ➁ The new machine integrates the NVIDIA HGX B200 with Intel Xeon 6900P series processors. ➂ Supermicro highlights innovations such as liquid-cooled PCIe switches and removable power supply modules for better system management and serviceability.
➀ Inventec and Astera Labs have showcased a 96x DDR5 DIMM memory shelf at the OCP Summit 2024; ➁ The shelf connects to an 8-way Intel Xeon 6 Granite Rapids-SP server with 128x DDR DIMM slots, offering a total of 224 DIMMs; ➂ The setup is designed for scale-up server applications, providing tens of TBs of memory in a single server.
➀ TrendForce predicts a further 10%+ drop in NAND contract prices in Q4; ➁ PC client SSD contract prices will decline by 5–10% due to limited AI practical use cases; ➂ Q4 server OEM orders have declined due to delays in AI server deployments; ➃ Smartphone and notebook manufacturers are adopting inventory reduction strategies, with Q4 eMMC and UFS prices expected to drop 8-13%.
➀ NAND Flash demand is weak, with contract prices expected to decline by 3-8% in Q4;
➁ TrendForce predicts that the decline in contract prices will be over 10% in Q4, with the exception of enterprise-level SSDs, which will only see a small increase of 5%;
➂ The demand for servers remains stable, but consumer markets are weak, and the supply exceeds demand due to overproduction and conservative procurement strategies.
➀ AMD's new EPYC 9005 Turin processors deliver exceptional performance with up to 768 threads per server, leveraging new Zen 5/ Zen 5c architecture and 25%+ TDP increase.➁ The processors are set to compete with Intel's server leadership, offering aggressive pricing and a range of SKUs with up to 192 cores.➂ Performance testing highlights the importance of using high-quality SSDs and NICs for optimal performance, with AMD's new platform providing a robust foundation for server environments.
➀ Honeywell's 2024 Technology Day kicks off with Chairman Liu Yangwei announcing the global first shipment of the NVIDIA GB200 AI server; ➁ Honeywell will become the first company to mass produce servers with these super chips, including key components, modules, and boards, servers, racks, high-performance switches, and AI data centers; ➂ Liu highlights the deep integration of AI in automation, which represents productivity, with clients reporting a doubling of production efficiency after automation is introduced in their factories; ➃ Honeywell's electric vehicle manufacturing plant in Kaohsiung will become a benchmark for AI smart factories, using digital twin technology to connect to the cloud and achieve synergy between virtual and physical production lines; ➄ The AI revolution is not limited to Taiwan but extends to North America and Asia, covering existing facilities, planned factories, and under-construction parks; ➅ This year marks the 50th anniversary of Honeywell, transitioning from manufacturing connectors to providing system solutions and developing complex core technology capabilities, aiming to build three AI-driven smart platforms.
➀ The review focuses on the Supermicro MegaDC ARS-211M-NR, an Ampere AmpereOne system with 192 custom Arm cores. It's the first time a second-generation Ampere Arm server is reviewed, showcasing significant evolution in the platform. The server is powered by an AmpereOne processor and features high-end cloud-native Arm server capabilities. ➁ The article provides an overview of the server's external hardware, including drive bays, PCIe connections, and I/O expansion slots. It also discusses the server's internal layout and the AmpereOne processor. ➂ The review highlights the server's capabilities and performance, emphasizing its role in the evolution of the Ampere Arm server platform.
➀ Tyan server brand is transitioning to MiTAC Computing; ➁ MiTAC Computing will be the primary brand, unifying Tyan and other brands under its name; ➂ This change is effective from October 1, 2024.
➀ This letter discusses the updates and activities of STH in Q3 2024, including the challenges and achievements in filming at the Paris 2024 Olympics, the upcoming server reviews, and the expansion of the STH team and channels. ➁ The author reflects on the growth of the STH YouTube channel and the introduction of the Axautik Group for more specialized content. ➂ The letter concludes with a call for team expansion and a reminder to subscribe to STH's newsletter and YouTube channel for more content.
➀ Intel's Clearwater Forest is set to be released in 2025, featuring new packaging technology and the Intel 18A process. The chip has been shown at an event in Oregon, where photos of the new Intel Xeon 6 parts and the high-core count next-generation E-core Xeon were taken. The CPU package is constructed differently from previous models, with a new layout for PCIe I/O and UPI links. ➁ The new chip is expected to kickstart the E-core CPU revolution on the x86 side, offering a significant improvement over the previous generation. ➂ The Clearwater Forest is still in development, with no launch date set yet, despite the fact that it is already booting.
➀ This video from ServeTheHome introduces the Intel Xeon 6900P Granite Rapids-AP processor, highlighting its core-for-core competitiveness with AMD's EPYC processors.➁ The video also covers the overall Intel Xeon 6 family and its performance aspects.➂ It includes B-roll footage of the system and other Intel Xeon 6 processors that are set to launch in Q1 2025.
➀ The Intel Xeon 6900P series, with 128 cores and 12 memory channels, marks Intel's return to server CPU leadership after trailing AMD for seven years; ➁ The series features new process technology and accelerators, aiming to compete with AMD's top-end parts; ➂ Intel's design strategy includes integrating memory controllers into compute tiles for better performance.
➀ The review focuses on the MiTAC Intel Denali Pass 2U 4-node liquid-cooled server system; ➁ The system is almost entirely liquid-cooled, with innovative features; ➂ MiTAC's expertise in building systems for hyper-scale customers is highlighted.
➀ HPE has launched a new 2U edge server, the ProLiant DL145, featuring AMD EPYC Siena processors with up to 64 cores; ➁ The server is designed for field deployment with various EDSFF storage options and PCIe expansion slots; ➂ It aims to provide a quieter alternative to traditional rackmount servers with an acoustic level of 40dba at 50% load.
➀ The MiTAC Intel DSG 3000W Fanless Liquid Cooled PSU is designed for Intel DSG servers and is now sold under the MiTAC brand; ➁ The PSU features an innovative liquid cooling design with an intake and outlet nozzle above the CRPS power supply PCB connector; ➂ It is 80Plus Titanium rated and utilizes a solid faceplate to block airflow, making it suitable for high-efficiency liquid-cooled server setups.
➀ This review explores the Tyan GC70-B8033 1U server, a lower-cost option for the AMD EPYC Milan generation; ➁ It highlights the unique features and design of the server, including front I/O access and tool-less drive bays; ➂ The article also discusses the server's power supply, cooling system, and overall build quality.
➀ This article discusses the importance of fully populating memory channels on CPUs featuring AMD EPYC Genoa; ➁ The author tests different memory configurations and finds that filling all memory channels maximizes memory bandwidth; ➃ The article concludes that filling memory channels is a good idea, especially for servers, to maximize performance.