Startups

New Zealand-based Imagr thinks camera-based AI is the future of shopping trolleys

Comment

Image Credits: Rebecca Bellan

When it comes to contactless, automated supermarket shopping, Imagr is backing a vision-based approach. But unlike Amazon Go stores, which use cameras and sensors to monitor the shopper as they walk in and out without scanning or paying at checkout, this New Zealand-based company thinks the only images that should be captured and analyzed are those of products going into a shopping cart.

The early-stage startup has invented tech that attaches to the trolley and uses cameras to detect and label products, adding them to a virtual cart where shoppers can checkout without ever interacting with a human or waiting in a line. 

The contactless shopping space has been growing slowly for years, but more recently it has seen a boost in the pandemic era, where the less we share air with another human, the better. The value of transactions processed by frictionless checkout technology is estimated to reach $387 billion by 2025, according to a 2020 study from Juniper Research.

“With COVID, I think what you probably saw was a huge rush on supermarkets that really exposed a number of things retailers weren’t prepared for,” Will Chomley, CEO and co-founder, told TechCrunch. “It also really highlighted the fact that the end user wanted a solution that was completely frictionless, and it demonstrated that their infrastructure was not capable of handling that sort of thing. But it also showed that as staff started to refuse to turn up to work because they didn’t want to catch it, retailers needed solutions to be able to run these stores on less staff.”

Amazon’s branded “Just Walk Out” technology is expanding internationally via its Amazon Fresh convenience stores, which can be found in the U.S. and the U.K. Chomley says this scares retailers who fear competition from the tech giant. At the same time, countries around the world are looking at going cashless, making this a ripe moment to focus on the frictionless checkout space. 

Imagr, which recently had a pop-up shop in London to demonstrate its tech, is currently raising its Series A after it raised $9.5 million in seed funding at the end of November 2019 in a round led by Toshiba Tec. Chomley says Imagr has raised a total of $12.5 million to date, and as it raises its next round, is in the market for strategic partners rather than just VC money. The company says the tech is there, it just needs to scale. 

The startup’s original smart shopping carts, complete with a halo on top that houses cameras and lights to detect products going in and out of the cart, can be seen in Japan’s 150 H2O Retailing stores, and the company says it has one contract due to go live this year in the U.K., as well as another two in the works and some other plans in Europe that can’t yet be confirmed publicly. 

The haloed version of the shopping cart is not, however, the end product for Imagr. The plan is to roll out a more modular version by Q4, where instead of an entire cart, you get three pieces of hardware that attach to a standard cart. Each module will have its own set of lights and cameras, as well as a microprocessor where data is analyzed, then sent up into the cloud and back to the shopper’s app and virtual cart with less than one second latency. Chloe Lamb, brand and communications lead, says Imagr has built a prototype that’s currently for sale. 

Lamb also said the modular method just makes more sense when scaling. Smart carts can cost retailers between $5,000 and $10,000 per unit and require a lot of maintenance compared to simple shopping carts, which tend to cost retailers less than $100 and will get beat up for years before being replaced. Amazon’s “Just Walk Out” tech is expected to cost retailers upwards of $1 million for installation and hardware, and that doesn’t include maintenance over time. Currently, the full system that it’s piloting is about $75,000 and includes 10 carts, an imaging station, a server station to run the system, full integration into a customer-facing store and Imagr support over the duration of the pilot. Imagr didn’t share how much its current model of trolleys cost versus its modular system, but says it’ll be a cheaper endeavor.

Shopic, an Israeli smart trolley company, also has a smaller piece of hardware that attaches to a cart and uses computer vision to detect products, but the difference is it includes a touchscreen display on the cart where you can see your constantly updated receipt. Shopic also uses the screen for an additional revenue stream in the form of advertising dollars, displaying ads based on the customer’s shopping history.

“They have the hardware, but we have the software,” said Lamb. “Our vision/AI is better. Like, we’ve cracked the hardest part of it and it’s the AI, and for us it’s been figuring out how we put that in a smaller vessel.” 

Shopic and Amazon aren’t the only other hopefuls in this space. Standard Cognition has copied Amazon’s style of walk-out tech to distribute to stores. Earlier this year, the San Francisco-based company, which is now valued at $1 billion, raised $150 million in a Series C and announced a partnership with Circle K, the convenience store chain owned by Alimentation Couche-Tard Inc.

Aside from being kind of creepy — the all-seeing cameras may be trained on what you are buying but also are scanning the store, and you, at large — Lamb says the walk-out tech that Standard is offering is incredibly expensive and not at all scalable in the short term. 

“You couldn’t overhead that,” said Lamb. “The maintenance alone, having to have AI engineers on site, plus the storage capacity needed for all the data you collect. The server room you would need would be intense.” 

Running the Imagr system in one store uses the same amount of data as streaming HD Netflix for a day, the company said. 

“Shopping carts just made sense to me because everyone already used carts or baskets, they were what retailers were comfortable buying and what users were comfortable using,” said Chomley. “It didn’t require a huge overhaul of the systems. It’s the method of least disruption, faster payback period, better customer experience and no privacy concerns.”

And while it’s within the realm of possibility that the approach of above-head tech gets cheaper over time, it’s not as quick or clear of a path to market, claimed Chomley. 

“Amazon proved the market; it proved that the end user wants something frictionless, and I think that’s really healthy for our business,” said Chomley. “But what Amazon did is they built a supermarket for the technology, whereas we have built technology for a supermarket. And that’s where retailers will say we can’t process 1.6 terabytes of information every second. We need something that fits into our store and our operations.”

As items go into Imagr’s shopping cart, they appear in the app’s virtual cart. Image Credits: Rebecca Bellan

Lamb says many retailers look at Imagr as an elevation from the scan-and-shop because it’s not too far off in terms of pricing, but the difference is retailers get to see what’s in the cart. It’s a lot harder to shoplift by pretending to scan an item when the cart is watching and making a record of what goes in and out.

Imagr offers a white-label solution for retailers that they can own, operate and scale themselves. This means the retailer would own all the hardware, software and the white-labeled app. Imagr has a shared licensing agreement for data with retailers because it needs to get smarter and keep training its models. Lamb said that Imagr hopes to offer inventory analytics in the future to help retailers avoid inventory distortion. 

“Our intention would be to essentially provide them the ability to track everything that comes in and out,” said Lamb. “In a perfect world, like, I don’t know all the Coke sells out, and it pings one of the retail workers in the store and she’s got to restock shelf 7A. That’s what we’re working towards. We don’t have a hard solution for it but there’s definitely demand for that.”

Corrections: A previous version of this article stated Shopic used barcode scanners but has since been updated with the correct information. This article has been updated to reflect that Amazon’s “Just Walk Out” technology is expanding internationally via its Amazon Go and Amazon Fresh stores. 

6 tips for establishing your startup’s global supply chain

More TechCrunch

After educating the D.C. market, YC aims to leverage its influence, particularly in areas like competition policy.

DC’s political class doesn’t know Y Combinator exists, but it’s trying to change that

Lina Khan says the FTC wants to be effective in its enforcement strategy, which is why it has been taking on lawsuits that “go up against some of the big…

FTC Chair Lina Khan says the agency is going after the ‘mob bosses’ in Big Tech

With dozens of antitrust cases and close to a hundred on the consumer protection side, the agency is now turning to innovative tactics to help it fight fraud, particularly in…

FTC Chair Lina Khan shares how the agency is looking at AI

The ability to pause your activity rings is a minor feature update for most, but for those of us who obsess about such things to an unhealthy degree, it’s the…

Apple Watch is finally adding a feature I’ve been requesting for years

Featured Article

Why Apple is taking a small-model approach to generative AI

It’s a very Apple approach in the sense that it prioritizes a frictionless user experience above all.

5 hours ago
Why Apple is taking a small-model approach to generative AI

When generative AI tools started making waves in late 2022 after the launch of ChatGPT, the finance industry was one of the first to recognize these tools’ potential for speeding…

Linq raises $6.6M to use AI to make research easier for financial analysts

In addition to the federal funding, the state of New Mexico — where SolAero is based — committed to providing financing and incentives that value $25.5 million.

Biden administration looks to give Rocket Lab $24M to boost space-grade solar cell production

Some of the new Apple Intelligence features that Apple debuted at WWDC 2024 don’t even feel like AI, they just feel like smarter tools. 

Apple’s AI, Apple Intelligence, is boring and practical — that’s why it works

The TechCrunch team runs down all of the biggest news from the Apple WWDC 2024 keynote in an easy-to-skim digest.

Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover

Jordan Meyer and Mathew Dryhurst founded Spawning AI to create tools that help artists exert more control over how their works are used online. Their latest project, called Source.Plus, is…

Spawning wants to build more ethical AI training datasets

After leading the social media landscape, TikTok appears to be interested in challenging Google’s dominance in search. The company confirmed to TechCrunch that it’s testing the ability for users to…

TikTok comes for Google as it quietly rolls out image search capabilities in TikTok Shop

General Motors is investing $850 million into Cruise as the autonomous vehicle subsidiary slowly makes its way back to testing in Phoenix, Dallas and, as of Tuesday, Houston. GM’s CFO…

GM gives Cruise $850M lifeline as it relaunches robotaxis in Houston

These messaging features, announced at WWDC 2024, will have a significant impact on how people communicate every day.

At last, Apple’s Messages app will support RCS and scheduling texts

Welcome to TechCrunch Fintech! This week, we’re looking at Rippling’s controversial decision to ban some former employees from selling their stock, Carta’s massive valuation drop, a GenZ-focused fintech raise, and…

Rippling’s tender offer decision draws mixed — and strong — reactions

Google is finally making its Gemini Nano AI model available to Pixel 8 and 8a users after teasing it in March.

Google’s June Pixel feature drop brings Gemini Nano AI model to Pixel 8 and 8a users

At WWDC 2024, Apple introduced new options for developers to promote their apps and earn more from them in the App Store.

Apple adds win-back subscription offers and improved search suggestions to the App Store

iOS 18 will be available in the fall as a free software update.

Here are all the devices compatible with iOS 18

The acquisition comes as BeReal was struggling to grow its user base and was looking for a buyer.

BeReal is being acquired by mobile apps and games company Voodoo for €500M

Unlike Light’s older phones, the Light III sports a larger OLED display and an NFC chip to make way for future payment tools, as well as a camera.

Light introduces its latest minimalist phone, now with an OLED screen but still no addictive apps

Since April, a hacker with a history of selling stolen data has claimed a data breach of billions of records — impacting at least 300 million people — from a…

The mystery of an alleged data broker’s data breach

Diversity Spotlight is a feature on Crunchbase that lets companies add tags to their profiles to label themselves.

Crunchbase expands its diversity-tracking feature to Europe

Thanks to Apple’s newfound — and heavy — investment in generative AI tech, the company had loads to showcase on the AI front, from an upgraded Siri to AI-generated emoji.

The top AI features Apple announced at WWDC 2024

A Finnish startup called Flow Computing is making one of the wildest claims ever heard in silicon engineering: by adding its proprietary companion chip, any CPU can instantly double its…

Flow claims it can 100x any CPU’s power with its companion chip and some elbow grease

Five years ago, Day One Ventures had $11 million under management, and Bucher and her team have grown that to just over $450 million.

The VC queen of portfolio PR, Masha Bucher, has raised her largest fund yet: $150M

Particle announced it has partnered with news organization Reuters to collaborate on new business models and experiments in monetization.

AI news reader Particle adds publishing partners and $10.9M in new funding

Mistral AI has closed its much-rumored Series B funding round, raising €600 million (around $640 million) in a mix of equity and debt.

Paris-based AI startup Mistral AI raises $640M

Cognigy is helping create AI that can handle the highly repetitive, rote processes center workers face daily.

Cognigy lands cash to grow its contact center automation business

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

Featured Article

Raspberry Pi is now a public company

Raspberry Pi priced its IPO on the London Stock Exchange on Tuesday morning at £2.80 per share, valuing it at £542 million, or $690 million at today’s exchange rate.

16 hours ago
Raspberry Pi is now a public company

Hello and welcome back to TechCrunch Space. What a week! In the same seven-day period, we watched Boeing’s Starliner launch astronauts to space for the first time, and then we…

TechCrunch Space: A week that will go down in history