Startups

DriveU.auto to power remote piloting of EasyMile’s autonomous shuttles, Coco’s sidewalk robots

Comment

Teleoperator remotely drives autonomous vehicles on DriveU.auto's platform
Image Credits: DriveU.auto

Autonomous shuttle company EasyMile and sidewalk robot delivery startup Coco are integrating DriveU.auto’s teleoperation and connectivity platform into their operations, DriveU.auto, an Israeli startup that came out of stealth last year, they announced at CES.

The autonomous vehicle industry is still a ways off from being able to commercialize full self-driving technology, despite the promises certain companies have made or the way they choose to name their advanced driver assistance systems. Indeed most countries still require a human to be in the loop during autonomous operations for safety purposes. To get to market faster and increase public acceptance of driverless vehicles, AV companies are turning to teleoperations, where a remote driver can swoop in to pilot the vehicles in the event of an emergency, anomaly or safety incident.

“Think of the site of an accident where there are multiple police officers gesturing at traffic to drive around,” Alon Podhurst, CEO at DriveU.auto, told TechCrunch. “The AI of the vehicle will in all likelihood ask for assistance to interpret these gestures and vocal commands. The remote operator needs to see a real-time view of the world around the vehicle she is assisting — a robot or an autonomous vehicle…We want to stream the feed from the vehicle sensors to the remote operator’s location. This must be done in a manner ensuring reliable, high-quality and low-latency connectivity so that the decisions being made by the remote operator are based on the actual real-world situation around the vehicle. This is done over cellular networks.”

Much of the success of teleoperations relies on high-performance connectivity in order to transfer video, audio and other sensor data. DriveU.auto’s connectivity platform aims to ensure stable network connections and avoid any latency, “dark spots” or drops in connection that could prevent a teleoperator intervening to help an autonomous vehicle.

“No single cellular network — not even 5G — can guarantee the performance levels needed for reliable remote operation,” said Podhurst. “Remember, the task is to transmit multiple feeds, as there are multiple cameras on the vehicle, of high-definition video over a constrained cellular network, from a moving vehicle. Bottom line — one network is not enough.”

DriveU.auto’s tech is already live on a fleet of EasyMile’s EZ10 autonomous shuttles that are serving a medical complex in France, and the company is in the process of integrating into the entire EasyMile fleet, according to Podhurst.

“As we continue to deploy more and more use cases for autonomous vehicles, we expect remote supervision to be a key component of our solution,” said Benoit Perrin, managing director of EasyMile, in a statement.

The startup’s connectivity solution is also already in Coco’s fleet of about 100 Coco 0 units, its proof-of-concept pilot vehicle. The plan is to integrate the platform into the new shipment of 1,000 Coco 1 robots, the hardware base of which is being built by Segway and will be deployed in Los Angeles and two other U.S. cities during Q1 2022, according to Coco.

Aside from EasyMile and Coco, the startup says it is already operational on robotaxis, autonomous trucks, other delivery robots and special use case AVs, all partnerships that are still under non-disclosure agreements, but Podhurst says he hopes to go public in the coming weeks. The company recently announced an 18-month partnership with Denso, a Japanese auto parts manufacturer.

DriveU.auto typically provides customers with a software development kit that is integrated into the vehicles’ computers. Customers operate their own vehicles, including the teleoperation, relying on the vehicle’s existing sensor suite and other hardware components. Podhurst says this software-only approach is a key component in the company’s market traction because it makes for faster integrations.

The software-based connectivity platform works by fusing three technologies: dynamic video encoding, low-latency algorithms and cellular bonding. The fused data package is then sent over multiple cellular networks based on the performance of the networks at the time of the transmission. The data is then reconstructed as video frames once it reaches the remote operator side. To break it down further, the platform is essentially made up of software modules that are integrated into the vehicle’s system and that interoperate with both a cloud-based software component and a module that’s been integrated into the remote operator’s computer.

“Integrating a superior connectivity solution on delivery robots dictates extremely demanding power and compute parameters,” said Sahil Sharma, COO of Coco, in a statement. “Having evaluated the industry leaders in this space, we found DriveU’s solution to be the strongest match for our growth plans and aggressive delivery schedules.”  

Read more about CES 2022 on TechCrunch

More TechCrunch

Mobile app developers, including Patreon and Grammarly, are already integrating with Gemini Nano, its smallest AI model, the company announced during its I/O developer keynote on Tuesday. The companies, along…

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls

The standard Gemma models were only available in 2 billion and 7 billion parameter versions, making this quite a step up.

Google announces Gemma 2, a 27B-parameter version of its open model, launching in June

This is a great example of a company using generative AI to open its software to more users.

Google TalkBack will use Gemini to describe images for blind people

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

Google’s Circle to Search feature will now be able to solve more complex problems across psychics and math word problems. 

Circle to Search is now a better homework helper

People can now search using a video they upload combined with a text query to get an AI overview of the answers they need.

Google experiments with using video to search, thanks to Gemini AI

A search results page based on generative AI as its ranking mechanism will have wide-reaching consequences for online publishers.

Google will soon start using GenAI to organize some search results pages

Google has built a custom Gemini model for search to combine real-time information, Google’s ranking, long context and multimodal features.

Google is adding more AI to its search results

At its Google I/O developer conference, Google on Tuesday announced the next generation of its Tensor Processing Units (TPU) AI chips.

Google’s next-gen TPUs promise a 4.7x performance boost

Google is upgrading Gemini, its AI-powered chatbot, with features aimed at making the experience more ambient and contextually useful.

Google’s Gemini updates: How Project Astra is powering some of I/O’s big reveals

Veo can generate few-seconds-long 1080p video clips given a text prompt.

Google’s image-generating AI gets an upgrade

At Google I/O, Google announced upgrades to Gemini 1.5 Pro, including a bigger context window. .

Google’s generative AI can now analyze hours of video

The AI upgrade will make finding the right content more intuitive and less of a manual search process.

Google Photos introduces an AI search feature, Ask Photos

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8B in App Store fraud last year in latest pitch to developers

Online travel agency Expedia is testing an AI assistant that bolsters features like search, itinerary building, trip planning, and real-time travel updates.

Expedia starts testing AI-powered features for search and travel planning