AI infrastructure boom raises Q2 GPU and accelerator revenue to $54B

Sept. 26, 2024
A new Dell’Oro Group report noted that general-purpose computing component revenues also jumped.

Primarily driven by high demand for GPUs and custom accelerators in the hyperscale cloud market, sales of GPUs and accelerators reached a record $54 billion in 2Q 2024.

A new Dell’Oro report revealed that more growth is coming in the sector.

The research firm forecasts an uptick in the server and storage systems component and server CPU markets.

The server and Storage Systems Component market is forecast to increase by over 100 percent in 2024, while the server CPU market is also experiencing a recovery, although growth has lagged that of other component categories.

Meanwhile, smart NIC and DPU revenues more than doubled in 2Q 2024, driven by strong deployment of network adapters in AI clusters.

Unsurprisingly, NVIDIA led all vendors in component revenues, followed by Samsung and Intel. NVIDIA accounted for nearly half of the reported component revenues.

Accelerators' strong growth will continue into 2025 as NVIDIA’s Blackwell platform ships in volume. We also anticipate that custom accelerators and other vendors, such as AMD and Intel, will gain some market share in select segments.

“Server and storage system component revenues surged 127 percent year-over-year in 2Q 2024, reaching a new peak. This growth was propelled by accelerators, such as GPUs and custom accelerators, HBMs, and Ethernet adapters for generative AI applications,” said Baron Fung, senior research director at Dell’Oro Group. “Additionally, memory and storage drive components for non-AI workloads contributed to this growth as prices rose from last year’s low.”

Fung added, “In anticipation of increased server and storage demand later this year, OEMs and cloud service providers replenished inventories."

For related articles, visit the Business Topic Center.
For more information on high-speed transmission systems and suppliers, visit the Lightwave Buyer’s Guide.
To stay abreast of fiber network deployments, subscribe to Lightwave’s Service Providers and Datacom/Data Center newsletters.

About the Author

Sean Buckley

Sean is responsible for establishing and executing the editorial strategies of Lightwave and Broadband Technology Report across their websites, email newsletters, events, and other information products.

Sponsored Recommendations

How AI is driving new thinking in the optical industry

Sept. 30, 2024
Join us for an interactive roundtable webinar highlighting the results of an Endeavor Business Media survey to identify how optical technologies can support AI workflows by balancing...

The AI and ML Opportunity

Sept. 30, 2024
Join our AI and ML Opportunity webinar to explore how cutting-edge network infrastructure and innovative technologies can meet the soaring demands of AI memory and bandwidth, ...

The Perils of Using a Broadband Power Meter in a PON World

Nov. 7, 2023
Learn about the potential significant problems for multi-service PON activation and troubleshooting when using a broadband power meter.

Advances in Fiber & Cable

Oct. 3, 2024
November 7, 2024 1:00 PM ET / 12:00 PM CT / 10:00 AM PT / 6:00 PM GMT Duration: 1 hour Already registered? Click here to log in. A certificate of attendance...