The initial boom in artificial intelligence (AI) data center investment centered around hardware for training AI models — workloads that demand massive parallel-processing capabilities. Graphics processing units (GPUs) are powerful and flexible parallel processors, and that property propelled the rise of GPU specialist Nvidia (NASDAQ: NVDA) from an ordinary large cap worth around $350 billion at the start of 2023 to its current position as the world’s most valuable company. Today, it’s worth more than $5 trillion.

But data centers are growing in size, creating cost constraints and an AI energy bottleneck. What’s more, hyperscalers’ needs are evolving as AI inference becomes a growing part of the overall workload. While training is needed to build a model’s intelligence, inference applies that intelligence in real-world applications, such as through AI chatbots, AI agents, robotics, and self-driving cars.

Missed Nvidia in 2009? This Rare Signal Is Flashing Again. In 2009, a “Double Down” signal flashed for a little-known chipmaker called Nvidia. For the first time in years, that same “Total Conviction” signal is flashing for a company 1/100th the size of Nvidia. Continue »

Application-specific integrated circuits (ASICs) aren’t nearly as flexible as GPUs, but they can be highly cost-effective at scale. This is why investment bank Goldman Sachs forecasts that demand for ASICs will surpass GPU demand in the coming years.

Broadcom (NASDAQ: AVGO) is the leading designer of ASICs, so it stands to benefit from that boom. But is the semiconductor stock a buy before it reports earnings on June 3?

Image source: Getty Images.

ASICs at the hyperscale

Alphabet‘s (NASDAQ: GOOGL) (NASDAQ: GOOG) Tensor Processing Units (TPUs), Meta Platforms(NASDAQ: META) Meta Training and Inference Accelerator (MTIA), and Amazon’s (NASDAQ: AMZN) Trainium chips are examples of ASICs.

Meta and Alphabet’s Google work with Broadcom’s custom accelerator platform to design their chips, while Amazon Web Services (AWS) has an in-house semiconductor division, Annapurna Labs.

Google and AWS have achieved cost savings and efficiency improvements by deploying their custom chips at scale for cloud services. Google uses TPUs to power its Gemini large language model and other AI-powered applications like Google Search, Google Maps, and Google Photos. Meta designed MTIA for its internal infrastructure, including its search and content recommendation algorithms.

Broadcom hasn’t been shy about quantifying the surging demand for ASICs. It’s forecasting that it will book $100 billion in fiscal 2027 sales from its AI chips alone. Beyond that, the company also has massive non-AI semiconductor and infrastructure software businesses. However, it would be a mistake for investors to assume ASICs will overtake GPUs in data centers.

Source link
See more: https://theglobaltrack.com/
https://corinthiames.com.br/