AI

New Zealand-based Imagr thinks camera-based AI is the future of shopping trolleys

Comment

Image Credits: Rebecca Bellan

When it comes to contactless, automated supermarket shopping, Imagr is backing a vision-based approach. But unlike Amazon Go stores, which use cameras and sensors to monitor the shopper as they walk in and out without scanning or paying at checkout, this New Zealand-based company thinks the only images that should be captured and analyzed are those of products going into a shopping cart.

The early-stage startup has invented tech that attaches to the trolley and uses cameras to detect and label products, adding them to a virtual cart where shoppers can checkout without ever interacting with a human or waiting in a line. 

The contactless shopping space has been growing slowly for years, but more recently it has seen a boost in the pandemic era, where the less we share air with another human, the better. The value of transactions processed by frictionless checkout technology is estimated to reach $387 billion by 2025, according to a 2020 study from Juniper Research.

“With COVID, I think what you probably saw was a huge rush on supermarkets that really exposed a number of things retailers weren’t prepared for,” Will Chomley, CEO and co-founder, told TechCrunch. “It also really highlighted the fact that the end user wanted a solution that was completely frictionless, and it demonstrated that their infrastructure was not capable of handling that sort of thing. But it also showed that as staff started to refuse to turn up to work because they didn’t want to catch it, retailers needed solutions to be able to run these stores on less staff.”

Amazon’s branded “Just Walk Out” technology is expanding internationally via its Amazon Fresh convenience stores, which can be found in the U.S. and the U.K. Chomley says this scares retailers who fear competition from the tech giant. At the same time, countries around the world are looking at going cashless, making this a ripe moment to focus on the frictionless checkout space. 

Imagr, which recently had a pop-up shop in London to demonstrate its tech, is currently raising its Series A after it raised $9.5 million in seed funding at the end of November 2019 in a round led by Toshiba Tec. Chomley says Imagr has raised a total of $12.5 million to date, and as it raises its next round, is in the market for strategic partners rather than just VC money. The company says the tech is there, it just needs to scale. 

The startup’s original smart shopping carts, complete with a halo on top that houses cameras and lights to detect products going in and out of the cart, can be seen in Japan’s 150 H2O Retailing stores, and the company says it has one contract due to go live this year in the U.K., as well as another two in the works and some other plans in Europe that can’t yet be confirmed publicly. 

The haloed version of the shopping cart is not, however, the end product for Imagr. The plan is to roll out a more modular version by Q4, where instead of an entire cart, you get three pieces of hardware that attach to a standard cart. Each module will have its own set of lights and cameras, as well as a microprocessor where data is analyzed, then sent up into the cloud and back to the shopper’s app and virtual cart with less than one second latency. Chloe Lamb, brand and communications lead, says Imagr has built a prototype that’s currently for sale. 

Lamb also said the modular method just makes more sense when scaling. Smart carts can cost retailers between $5,000 and $10,000 per unit and require a lot of maintenance compared to simple shopping carts, which tend to cost retailers less than $100 and will get beat up for years before being replaced. Amazon’s “Just Walk Out” tech is expected to cost retailers upwards of $1 million for installation and hardware, and that doesn’t include maintenance over time. Currently, the full system that it’s piloting is about $75,000 and includes 10 carts, an imaging station, a server station to run the system, full integration into a customer-facing store and Imagr support over the duration of the pilot. Imagr didn’t share how much its current model of trolleys cost versus its modular system, but says it’ll be a cheaper endeavor.

Shopic, an Israeli smart trolley company, also has a smaller piece of hardware that attaches to a cart and uses computer vision to detect products, but the difference is it includes a touchscreen display on the cart where you can see your constantly updated receipt. Shopic also uses the screen for an additional revenue stream in the form of advertising dollars, displaying ads based on the customer’s shopping history.

“They have the hardware, but we have the software,” said Lamb. “Our vision/AI is better. Like, we’ve cracked the hardest part of it and it’s the AI, and for us it’s been figuring out how we put that in a smaller vessel.” 

Shopic and Amazon aren’t the only other hopefuls in this space. Standard Cognition has copied Amazon’s style of walk-out tech to distribute to stores. Earlier this year, the San Francisco-based company, which is now valued at $1 billion, raised $150 million in a Series C and announced a partnership with Circle K, the convenience store chain owned by Alimentation Couche-Tard Inc.

Aside from being kind of creepy — the all-seeing cameras may be trained on what you are buying but also are scanning the store, and you, at large — Lamb says the walk-out tech that Standard is offering is incredibly expensive and not at all scalable in the short term. 

“You couldn’t overhead that,” said Lamb. “The maintenance alone, having to have AI engineers on site, plus the storage capacity needed for all the data you collect. The server room you would need would be intense.” 

Running the Imagr system in one store uses the same amount of data as streaming HD Netflix for a day, the company said. 

“Shopping carts just made sense to me because everyone already used carts or baskets, they were what retailers were comfortable buying and what users were comfortable using,” said Chomley. “It didn’t require a huge overhaul of the systems. It’s the method of least disruption, faster payback period, better customer experience and no privacy concerns.”

And while it’s within the realm of possibility that the approach of above-head tech gets cheaper over time, it’s not as quick or clear of a path to market, claimed Chomley. 

“Amazon proved the market; it proved that the end user wants something frictionless, and I think that’s really healthy for our business,” said Chomley. “But what Amazon did is they built a supermarket for the technology, whereas we have built technology for a supermarket. And that’s where retailers will say we can’t process 1.6 terabytes of information every second. We need something that fits into our store and our operations.”

As items go into Imagr’s shopping cart, they appear in the app’s virtual cart. Image Credits: Rebecca Bellan

Lamb says many retailers look at Imagr as an elevation from the scan-and-shop because it’s not too far off in terms of pricing, but the difference is retailers get to see what’s in the cart. It’s a lot harder to shoplift by pretending to scan an item when the cart is watching and making a record of what goes in and out.

Imagr offers a white-label solution for retailers that they can own, operate and scale themselves. This means the retailer would own all the hardware, software and the white-labeled app. Imagr has a shared licensing agreement for data with retailers because it needs to get smarter and keep training its models. Lamb said that Imagr hopes to offer inventory analytics in the future to help retailers avoid inventory distortion. 

“Our intention would be to essentially provide them the ability to track everything that comes in and out,” said Lamb. “In a perfect world, like, I don’t know all the Coke sells out, and it pings one of the retail workers in the store and she’s got to restock shelf 7A. That’s what we’re working towards. We don’t have a hard solution for it but there’s definitely demand for that.”

Corrections: A previous version of this article stated Shopic used barcode scanners but has since been updated with the correct information. This article has been updated to reflect that Amazon’s “Just Walk Out” technology is expanding internationally via its Amazon Go and Amazon Fresh stores. 

6 tips for establishing your startup’s global supply chain

More TechCrunch

“Running with scissors is a cardio exercise that can increase your heart rate and require concentration and focus,” says Google’s new AI search feature. “Some say it can also improve…

Using memes, social media users have become red teams for half-baked AI features

The European Space Agency selected two companies on Wednesday to advance designs of a cargo spacecraft that could establish the continent’s first sovereign access to space.  The two awardees, major…

ESA prepares for the post-ISS era, selects The Exploration Company, Thales Alenia to develop cargo spacecraft

Expressable is a platform that offers one-on-one virtual sessions with speech language pathologists.

Expressable brings speech therapy into the home

The French Secretary of State for the Digital Economy as of this year, Marina Ferrari, revealed this year’s laureates during VivaTech week in Paris. According to its promoters, this fifth…

The biggest French startups in 2024 according to the French government

Spotify is notifying customers who purchased its Car Thing product that the devices will stop working after December 9, 2024. The company discontinued the device back in July 2022, but…

Spotify to shut off Car Thing for good, leading users to demand refunds

Elon Musk’s X is preparing to make “likes” private on the social network, in a change that could potentially confuse users over the difference between something they’ve favorited and something…

X should bring back stars, not hide ‘likes’

The FCC has proposed a $6 million fine for the scammer who used voice-cloning tech to impersonate President Biden in a series of illegal robocalls during a New Hampshire primary…

$6M fine for robocaller who used AI to clone Biden’s voice

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Is it…

Tesla lobbies for Elon and Kia taps into the GenAI hype

Crowdaa is an app that allows non-developers to easily create and release apps on the mobile store. 

App developer Crowdaa raises €1.2M and plans a US expansion

Back in 2019, Canva, the wildly successful design tool, introduced what the company was calling an enterprise product, but in reality it was more geared toward teams than fulfilling true…

Canva launches a proper enterprise product — and they mean it this time

TechCrunch Disrupt 2024 isn’t just an event for innovation; it’s a platform where your voice matters. With the Disrupt 2024 Audience Choice Program, you have the power to shape the…

2 days left to vote for Disrupt Audience Choice

The United States Department of Justice and 30 state attorneys general filed a lawsuit against Live Nation Entertainment, the parent company of Ticketmaster, for alleged monopolistic practices. Live Nation and…

Ticketmaster antitrust lawsuit could give new hope to ticketing startups

The U.K. will shortly get its own rulebook for Big Tech, after peers in the House of Lords agreed Thursday afternoon to pass the Digital Markets, Competition and Consumer bill…

‘Pro-competition’ rules for Big Tech make it through UK’s pre-election wash-up

Spotify’s addition of its AI DJ feature, which introduces personalized song selections to users, was the company’s first step into an AI future. Now, Spotify is developing an alternative version…

Spotify experiments with an AI DJ that speaks Spanish

Call Arc can help answer immediate and small questions, according to the company. 

Arc Search’s new Call Arc feature lets you ask questions by ‘making a phone call’

After multiple delays, Apple and the Paris area transportation authority rolled out support for Paris transit passes in Apple Wallet. It means that people can now use their iPhone or…

Paris transit passes now available in iPhone’s Wallet app

Redwood Materials, the battery recycling startup founded by former Tesla co-founder JB Straubel, will be recycling production scrap for batteries going into General Motors electric vehicles.  The company announced Thursday…

Redwood Materials is partnering with Ultium Cells to recycle GM’s EV battery scrap

A new startup called Auggie is aiming to give parents a single platform where they can shop for products and connect with each other. The company’s new app, which launched…

Auggie’s new app helps parents find community and shop

Andrej Safundzic, Alan Flores Lopez and Leo Mehr met in a class at Stanford focusing on ethics, public policy and technological change. Safundzic — speaking to TechCrunch — says that…

Lumos helps companies manage their employees’ identities — and access

Remark trains AI models on human product experts to create personas that can answer questions with the same style of their human counterparts.

Remark puts thousands of human product experts into AI form

ZeroPoint claims to have solved compression problems with hyper-fast, low-level memory compression that requires no real changes to the rest of the computing system.

ZeroPoint’s nanosecond-scale memory compression could tame power-hungry AI infrastructure

In 2021, Roi Ravhon, Asaf Liveanu and Yizhar Gilboa came together to found Finout, an enterprise-focused toolset to help manage and optimize cloud costs. (We covered the company’s launch out…

Finout lands cash to grow its cloud spend management platform

On the heels of raising $102 million earlier this year, Bugcrowd is making good on its promise to use some of that funding to make acquisitions to strengthen its security…

Bugcrowd, the crowdsourced white-hat hacker platform, acquires Informer to ramp up its security chops

Google is preparing to build what will be the first subsea fiber-optic cable connecting the continents of Africa and Australia. The news comes as the major cloud hyperscalers battle it…

Google to build first subsea fiber-optic cable connecting Africa with Australia

The Kia EV3 — the new all-electric compact SUV revealed Thursday — illustrates a growing appetite among global automakers to bring generative AI into their vehicles.  The automaker said the…

The new Kia EV3 will have an AI assistant with ChatGPT DNA

Bing, Microsoft’s search engine, was working improperly for several hours on Thursday in Europe. At first, we noticed it wasn’t possible to perform a web search at all. Now it…

Bing’s API was down, taking Microsoft Copilot, DuckDuckGo and ChatGPT’s web search feature down too

If you thought autonomous driving was just for cars, think again. The “autonomous navigation” market — where ships steer themselves guided by AI, resulting in fuel and time savings —…

Autonomous shipping startup Orca AI tops up with $23M led by OCV Partners and MizMaa Ventures

The best known mycoprotein is probably Quorn, a meat substitute that’s fast approaching its 40th birthday. But Finnish biotech startup Enifer is cooking up something even older: Its proprietary single-cell…

Meet the Finnish biotech startup bringing a long-lost mycoprotein to your plate

Silo, a Bay Area food supply chain startup, has hit a rough patch. TechCrunch has learned that the company on Tuesday laid off roughly 30% of its staff, or north…

Food supply chain software maker Silo lays off ~30% of staff amid M&A discussions