Apple's new AI is made in Google data centers
Apple is using its own silicon to run new AI features, but it needs Google to train its models.
As the AI wars heat up, tech giants are tapping unusual partnerships behind the scenes.
Google employees faced a technical crisis after Apple requested more TPUs for AI training.
When Apple pulled back the curtain on its new AI features this week, much was made of the company's partnership with OpenAI that's set to put ChatGPT on millions of iPhones — a position Google had tried to negotiate for itself.
But Apple and Google had for months been working together behind the scenes, with Google giving Apple access to its data centers to train the iPhone maker's new AI models.
For years, Apple has leaned on Google's and Amazon's cloud services to store data for its products. For example, when Apple-device users do iCloud backups, they're often stored in Google's data centers. It's not a deal that either company tends to talk about, but it gets Apple access to thousands of Google's machines, helping it provide many of the software features iPhone users love and rely on.
TPUs OMG
When it came to training the AI models that power the iPhone maker's new Apple Intelligence, the company asked for additional access to Google's Tensor Processing Units for training. TPUs are chips specifically designed for artificial intelligence, and Google rents these out via its cloud service as an alternative to Nvidia graphics processing units.
Apple's request created a scramble inside Google in April, when Googlers became aware of technical issues that could've stopped them from delivering what Apple wanted on time.
It was known internally as an "OMG," a Google term for one-off urgent incidents that don't quite warrant a code red. A war room was convened inside Google, according to a person with direct knowledge of the incident.
'Bigfoot'
The team delivered for Apple after a few very long days, the person said. But it was a close call that could've been bad news for Apple, which has earned the nickname Bigfoot among Google Cloud employees because of how much of Google's data centers it uses.
Spokespeople for Google and Apple did not respond to requests for comment.
The partnership underscores how far behind Apple still is in the generative-AI race. Most of the impressive features of AI models must be at least partly handled in massive, energy-sucking data centers, which companies such as Microsoft, Google, and Amazon have spent years building. As a result, Apple is having to lean more heavily on these rivals as it tiptoes into the AI race.
As some eagle-eyed Apple watchers spotted, Apple's technical documentation hints at the Google partnership, with a mention that its AI models were trained using a combination of methods, "including TPUs and both cloud and on-premise GPUs."
When users try out Apple's new AI features, much of the work will happen on the device itself. More intensive tasks will be handed off to what Apple is saying are special data centers running new Apple-designed silicon. Where these servers are remains unclear.
Unexpected partnerships
But Apple is faced with a new reality where cloud computing and the chips to train AI models are a hot commodity, forcing it to tap partners that it also competes against.
For example, Apple's deal with OpenAI will give users access to a more-advanced chatbot than Apple can offer in the form of ChatGPT. It's also a boon for OpenAI, which gets new access to Apple's vast user base.
The AI wars are forcing tech companies to forge these crucial, sometimes unexpected, relationships. On Tuesday, Microsoft and Oracle announced a deal to give Microsoft access to Oracle's cloud servers for handling some OpenAI workloads. Previously, OpenAI ran exclusively on Microsoft's servers.
Bloomberg previously reported that Google and Apple were also in talks to bring Google's Gemini AI to iOS devices. A deal has not materialized, but that doesn't mean it won't happen.
Speaking in an interview after the WWDC keynote, the Apple executive Craig Federighi made it clear that Apple was open for business when it comes to AI partners, and even name-checked Google.
"We want to enable users ultimately to choose the models they want, maybe Google Gemini in the future," he said. "Nothing to announce right now."
Read the original article on Business Insider
