Special topic: focus on Google's 2024 Ithumb O developer Conference: real-time interaction, video model debut
At the Google IZP O developer conferenceUe4hllcrash, Google (GOOGUe4hllcrash.USUe4hllcrash, GOOGL.US) officially announced on TuesdayUe4hllcrashThe upcoming next generation artificial intelligence chip, the sixth generation tensor processing unit (TPU), is called "Trillium". The new generation of chips is expected to be available later this year. Sandal Sundar Pichai, the company's chief executive, said at a press conference before the launch that Google had more than a decade of pioneering experience in GPU technology, and that the new TPU was another important milestone in Google's technological innovation.
Google will introduce the latest developments of its TPU at every IPUP O conference. Although the new generation of chips will not be released until the end of the year, Pichai revealed that the computing performance of the new generation of TPU will be 4.7 times that of the previous generation. This significant improvement is due to the expansion of the chip matrix multiplication unit (MXU) and the improvement of the overall clock speed. At the same time, the memory bandwidth of the new Trillium chip has doubled.
The Trillium chip uses the third-generation SparseCore technology, which is a specialized accelerator designed to handle the oversized embedding that is common in complex sorting and recommendation tasks, resulting in faster model training and lower service latency.
Pichai also highlighted the energy-saving advantages of the new chip, describing Trillium as Google's most energy-efficient TPU to date. He pointed out that with the rapid growth of demand for artificial intelligence chips, continuously improving the energy efficiency of chips has become particularly critical. According to him, in the past six years, the demand for machine learning computing has increased by 1 million times, or about tenfold every year. The energy efficiency of the new generation TPU is 67% higher than that of the fifth generation.
Although Google typically launches a variety of TPU variants, it hasn't released more details about the new chips, including the cost of using them in Google's cloud services. In addition, Google announced earlier this year that it would be the first cloud service provider to offer NVDA.US 's latest generation of Blackwell processors, although developers won't be able to start using them until 2025.
Pichai concluded that Google will continue to invest in infrastructure to support the company's artificial intelligence development and open up new technological frontiers. As of Tuesday's close, the stock closed up 0.6% at $171.93.