- July 30, 2024
- 4 min read
Apple Chooses Google TPUs Over NVIDIA GPUs to Build Apple Intelligence
Apple Defies Norms, Embracing Google’s TPUs for AI Ambitions
In a surprising move that has sent ripples through the tech industry, Apple has revealed its decision to leverage Google’s Tensor Processing Units (TPUs) for training its cutting-edge AI models, a departure from the industry’s reliance on NVIDIA’s Graphics Processing Units (GPUs). This strategic choice underscores Apple’s commitment to pushing the boundaries of AI innovation while exploring alternatives to the established norms.
Unleashing the Power of Google’s TPUs
According to a technical paper published by Apple, the tech giant employed Google’s cloud-based TPU clusters, specifically the v4 and v5p versions, to train its highly anticipated Apple Foundation Model (AFM). This model forms the backbone of Apple’s ambitious AI initiative, dubbed Apple Intelligence, which is poised to power a wide range of AI-driven features across Apple’s product ecosystem.
“The AFM models are pre-trained on v4 and v5p Cloud TPU clusters with the AXLearn framework [Apple, 2023], a JAX [Bradbury et al., 2018] based deep learning library designed for the public cloud,” the company stated in the research paper.
Challenging NVIDIA’s Dominance
Apple’s decision to utilize Google’s TPUs over NVIDIA’s industry-standard GPUs is a significant departure from the norm. NVIDIA has long been the go-to choice for AI training, with its GPUs powering much of the world’s leading AI research. The company currently controls an impressive 95% of the AI chip market.
This move by Apple suggests that major tech companies are actively exploring alternatives to NVIDIA’s offerings, potentially driven by factors such as cost-efficiency, performance advantages, or strategic partnerships. It also highlights the growing capabilities of Google’s custom-designed TPUs, which were initially developed for internal use but are now available to external customers through the Google Cloud Platform.
Unprecedented Scale and Ambition
Apple’s research paper reveals the staggering scale of its AI ambitions and the computational power required to train advanced language models. For its server-based AI model, the company utilized an impressive 8,192 TPUv4 chips, while for the on-device AI model designed for iPhones and other Apple devices, 2,048 TPUv5p chips were employed.
This substantial deployment of Google’s TPUs underscores Apple’s commitment to pushing the boundaries of AI capabilities. As the AI arms race among tech giants intensifies, Apple’s hardware choices for its AI infrastructure will likely be closely watched by industry observers and competitors alike.
A Nuanced Approach to AI Supremacy
While Apple’s decision to partner with Google for AI training hardware may seem surprising, it demonstrates a nuanced approach to building out its AI capabilities. By developing its own chips for on-device AI processing while leveraging Google’s TPUs for server-based training, Apple is adopting a strategic mix of in-house innovation and external partnerships.
As generative AI continues to reshape industries and redefine the boundaries of technology, Apple’s foray into this realm with the Apple Intelligence framework signals its intent to compete more aggressively in the AI space. The company’s willingness to explore unconventional partnerships and embrace cutting-edge technologies underscores its commitment to staying at the forefront of innovation.
Conclusion
Apple’s decision to leverage Google’s TPUs for training its AI models is a bold move that challenges the status quo and highlights the tech giant’s relentless pursuit of innovation. By embracing alternative solutions and forging strategic partnerships, Apple is paving the way for a future where AI capabilities are no longer constrained by traditional boundaries.
As the AI landscape continues to evolve at a breakneck pace, it remains to be seen how this unconventional alliance between Apple and Google will shape the future of AI development and deployment. One thing is certain: Apple’s commitment to pushing the boundaries of what’s possible in the realm of AI is a testament to the company’s unwavering pursuit of excellence and its willingness to defy convention in the quest for groundbreaking technological advancements.