Robot brain builders are pushing out of their GPT-2 era

Physical AI is one of the hottest sectors in venture investing, with companies raising billions to apply the tools that gave large language models to robotics. That excitement helped deliver a big IPO for Unitree, China’s leading robot maker, which saw the company valued at $66 billion after its…

Physical AI is one of the hottest sectors in venture investing, with companies raising billions to apply the tools that gave large language models to robotics. That excitement helped deliver a big IPO for Unitree, China’s leading robot maker, which saw the company valued at $66 billion after its arrival on China’s equivalent of the Nasdaq. This week, however, the bottom fell out, and the company lost nearly half of its value. Analysts point to one obvious issue: While the robots’ physical capabilities are improving, they still lack the know-how to actually do value-creating work. At last week’s Actuate conference, a gathering of developers building AI brains for robots, the excitement was clear. The event has tripled in size since it kicked off in 2023, and had 1,500 attendees, according to the organizer, Foxglove, a company that helps physical AI model builders manage and visualize their data. The risk was also evident: A sign on a booth for Avala, another physical AI infrastructure player, promised to solve “the robotics data crisis.” That crisis is the lack of high-quality training data for AI models. Attempts to build generalized robots that can do any task are still far off, and using end-to-end learning for specific tasks still hasn’t delivered products with reliable, commercial performance. For developers, the answer is to better mimic the advances of the frontier AI labs — find or create more diverse datasets, mess with different training regimes, and figure out better reinforcement learning scenarios. Harry Mellsop, a founder of Antioch, a startup building simulation tools for model builders, suggests physical AI is in its “GPT-2 era,” the OpenAI model that pre-dated the arrival of ChatGPT. More data and compute will be needed to get over the hump, particularly GPUs optimized for ray tracing, which are used to create high-fidelity simulations. The furthest ahead are autonomous vehicles, in part because of the ability to collect relevant data from cars driven by people, and in part because the main task is to avoid contact, not manipulate the physical environment. Much of the tooling for model-building comes from autonomous vehicle companies; Foxglove, for example, was founded by former employees at Cruise, General Motor’s erstwhile self-driving effort. And now those car companies are increasingly betting that their investments in ML tooling will allow them to compete with dedicated humanoid makers. Tesla is already trying this with its Optimus robot, and now both AV-focused Wayve and rideshare giant Uber have launched robotics labs focused on humanoid form factors as R&D efforts. “I think you need to start in vehicles…manipulation robotics is like self-driving five years ago,” Alex Kendall, the CEO of Wayve, told TechCrunch. “The data infrastructure, the simulation, ML ops infrastructure, will probably be shared, but the specific world model for the simulator will be a different post-training. There’s going to be a lot more commonality than not, but then there’s going to need to be some differences for different embodiments.” Kendall argues that it’s too early to commit to any one hardware platform — advances in sensors and other components are coming quickly, and a truly general model should be more agnostic. Théophile Gervet, the CEO of Genesis AI, a vertically integrated humanoid robotics company that raised a $105 million seed round this year, disagreed, telling TechCrunch “we’re too early in this wave for a brain strategy to work; our take is there’s lots of opportunities to co-design hardware and AI.” Gervet also touched on another hot topic in the sector: How specifically to focus your physical AI business. Robotics companies that are targeting specific tasks are getting their robots out in the field — Gritt is building solar farms, Agility is deploying robots in industrial settings, and Bedrock is operating excavators autonomously. Meanwhile, general-purpose humanoids aren’t getting out of the labs. “No customer cares about the general-purpose robot that works at 80% success rate,” Gervet said of the dilemma. “We see a lot of other players go general, but there is no value provided because there’s no vertical focus. … but then, if you’re building [for a narrow] vertical on top of GPT-2, you’re going to get crushed by the company building on GPT-4.” The temptation to invest in a specific vertical, however, is tempting because it provides not just revenue but also real-world deployment data. While task-specific data might not have enough diversity to push general-purpose models forward, it is important for making a robot that adds value. Bedrock CTO Kevin Peterson noted that his company was just starting with excavation as a way to understand the challenges of “manipulation in the wild,” but plans to develop an intelligence layer that stretches across a series of construction machines. Managing all that data is a challenge, especially because of the density of visual and lidar data. Foxglove announced a new product this week, built on top of Nvidia’s Cosmos open-weight world model, which allows engineers to search that data with sophisticated natural language queries to build out evaluations and simulations. The goal is faster triage and debugging so model builders can iterate faster. So what will be the fabled ChatGPT moment for physical AI that Sam Altman recently said is just a few years away? Kendall points out that the largest robot deployment in the world is still consumer vacuum bots. For him, a ChatGPT moment would be something that excites consumers, not investors, who seem to be plenty excited already. “One example of that would be when you get eyes-off autonomy for less than $1,000 [worth of hardware] in a car,” Kendall says; not coincidentally, his company is licensing models to car makers in an effort to produce just that. And that business, which he sees as a multibillion-dollar opportunity, will allow them to build a truly general embodied AI model. For Gervet, the moment when physical AI becomes real is “manipulation that just works out of the box. You can talk to a robot in natural language and have it do any basic task for manipulation, like say pushing, pulling, closing a laptop, cleaning up a table, whatever you want to do, and it works to some level of reliability, let’s say 80% plus out of the box — that’s roughly your ChatGPT experience.” Adrian Macneil, Foxglove’s CEO, looks at the question a bit differently. “There will not be a ChatGPT moment for robotics,” he told TechCrunch. “The thing that made ChatGPT a moment in time was the distribution — they went from zero to like a million active users in like a week… distribution in the real world is way harder than that, right? I would be very excited for the Apple II moment in robotics or the IBM PC moment in robotics. When can I buy like a home robot that is gonna start doing some useful and fun stuff?” Topics AI, Exclusive, physical ai, Robotics When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence. Tim Fernholz Senior Reporter Tim Fernholz is a journalist who writes about technology, finance and public policy. He has closely covered the rise of the private space industry and is the author of Rocket Billionaires: Elon Musk, Jeff Bezos and the New Space Race. Formerly, he was a senior reporter at Quartz, the global business news site, for more than a decade, and began his career as a political reporter in Washington, D.C. You can contact or verify outreach from Tim by emailing tim.fernholz@techcrunch.com or via an encrypted message to tim_fernholz.21 on Signal. View Bio October 13 – 15 San Francisco Don’t miss out. The startup community will gather to answer a pivotal question: How do you build sustainably in the AI era? REGISTER NOW Most Popular Fitbit founders launch Luffu Link, an LTE health and safety band Aisha Malik Two years after launch, Walmart’s Flipkart is closing in on India’s quick-commerce leaders Jagmeet Singh Inherent, founded by DeepMind alumni, says its AI ‘teammate’ just outperformed Anthropic and OpenAI at replicating research Anna Heim Michael Polansky is training an AI model on skin that’s still alive Connie Loizos How AI accounting startup Rillet raised $100M and became a unicorn in 48 hours Dominic-Madori Davis Tesla’s solar roof is dead — here’s what went wrong Tim De Chant Oura faces lawsuit accusing it of misleading consumers about sleep-tracking accuracy Aisha Malik

Source: TechCrunch — Published — Category: Business

🔗 Read full article on TechCrunch →