AI

New Zealand-based Imagr thinks camera-based AI is the future of shopping trolleys

Comment

Image Credits: Rebecca Bellan

When it comes to contactless, automated supermarket shopping, Imagr is backing a vision-based approach. But unlike Amazon Go stores, which use cameras and sensors to monitor the shopper as they walk in and out without scanning or paying at checkout, this New Zealand-based company thinks the only images that should be captured and analyzed are those of products going into a shopping cart.

The early-stage startup has invented tech that attaches to the trolley and uses cameras to detect and label products, adding them to a virtual cart where shoppers can checkout without ever interacting with a human or waiting in a line. 

The contactless shopping space has been growing slowly for years, but more recently it has seen a boost in the pandemic era, where the less we share air with another human, the better. The value of transactions processed by frictionless checkout technology is estimated to reach $387 billion by 2025, according to a 2020 study from Juniper Research.

“With COVID, I think what you probably saw was a huge rush on supermarkets that really exposed a number of things retailers weren’t prepared for,” Will Chomley, CEO and co-founder, told TechCrunch. “It also really highlighted the fact that the end user wanted a solution that was completely frictionless, and it demonstrated that their infrastructure was not capable of handling that sort of thing. But it also showed that as staff started to refuse to turn up to work because they didn’t want to catch it, retailers needed solutions to be able to run these stores on less staff.”

Amazon’s branded “Just Walk Out” technology is expanding internationally via its Amazon Fresh convenience stores, which can be found in the U.S. and the U.K. Chomley says this scares retailers who fear competition from the tech giant. At the same time, countries around the world are looking at going cashless, making this a ripe moment to focus on the frictionless checkout space. 

Imagr, which recently had a pop-up shop in London to demonstrate its tech, is currently raising its Series A after it raised $9.5 million in seed funding at the end of November 2019 in a round led by Toshiba Tec. Chomley says Imagr has raised a total of $12.5 million to date, and as it raises its next round, is in the market for strategic partners rather than just VC money. The company says the tech is there, it just needs to scale. 

The startup’s original smart shopping carts, complete with a halo on top that houses cameras and lights to detect products going in and out of the cart, can be seen in Japan’s 150 H2O Retailing stores, and the company says it has one contract due to go live this year in the U.K., as well as another two in the works and some other plans in Europe that can’t yet be confirmed publicly. 

The haloed version of the shopping cart is not, however, the end product for Imagr. The plan is to roll out a more modular version by Q4, where instead of an entire cart, you get three pieces of hardware that attach to a standard cart. Each module will have its own set of lights and cameras, as well as a microprocessor where data is analyzed, then sent up into the cloud and back to the shopper’s app and virtual cart with less than one second latency. Chloe Lamb, brand and communications lead, says Imagr has built a prototype that’s currently for sale. 

Lamb also said the modular method just makes more sense when scaling. Smart carts can cost retailers between $5,000 and $10,000 per unit and require a lot of maintenance compared to simple shopping carts, which tend to cost retailers less than $100 and will get beat up for years before being replaced. Amazon’s “Just Walk Out” tech is expected to cost retailers upwards of $1 million for installation and hardware, and that doesn’t include maintenance over time. Currently, the full system that it’s piloting is about $75,000 and includes 10 carts, an imaging station, a server station to run the system, full integration into a customer-facing store and Imagr support over the duration of the pilot. Imagr didn’t share how much its current model of trolleys cost versus its modular system, but says it’ll be a cheaper endeavor.

Shopic, an Israeli smart trolley company, also has a smaller piece of hardware that attaches to a cart and uses computer vision to detect products, but the difference is it includes a touchscreen display on the cart where you can see your constantly updated receipt. Shopic also uses the screen for an additional revenue stream in the form of advertising dollars, displaying ads based on the customer’s shopping history.

“They have the hardware, but we have the software,” said Lamb. “Our vision/AI is better. Like, we’ve cracked the hardest part of it and it’s the AI, and for us it’s been figuring out how we put that in a smaller vessel.” 

Shopic and Amazon aren’t the only other hopefuls in this space. Standard Cognition has copied Amazon’s style of walk-out tech to distribute to stores. Earlier this year, the San Francisco-based company, which is now valued at $1 billion, raised $150 million in a Series C and announced a partnership with Circle K, the convenience store chain owned by Alimentation Couche-Tard Inc.

Aside from being kind of creepy — the all-seeing cameras may be trained on what you are buying but also are scanning the store, and you, at large — Lamb says the walk-out tech that Standard is offering is incredibly expensive and not at all scalable in the short term. 

“You couldn’t overhead that,” said Lamb. “The maintenance alone, having to have AI engineers on site, plus the storage capacity needed for all the data you collect. The server room you would need would be intense.” 

Running the Imagr system in one store uses the same amount of data as streaming HD Netflix for a day, the company said. 

“Shopping carts just made sense to me because everyone already used carts or baskets, they were what retailers were comfortable buying and what users were comfortable using,” said Chomley. “It didn’t require a huge overhaul of the systems. It’s the method of least disruption, faster payback period, better customer experience and no privacy concerns.”

And while it’s within the realm of possibility that the approach of above-head tech gets cheaper over time, it’s not as quick or clear of a path to market, claimed Chomley. 

“Amazon proved the market; it proved that the end user wants something frictionless, and I think that’s really healthy for our business,” said Chomley. “But what Amazon did is they built a supermarket for the technology, whereas we have built technology for a supermarket. And that’s where retailers will say we can’t process 1.6 terabytes of information every second. We need something that fits into our store and our operations.”

As items go into Imagr’s shopping cart, they appear in the app’s virtual cart. Image Credits: Rebecca Bellan

Lamb says many retailers look at Imagr as an elevation from the scan-and-shop because it’s not too far off in terms of pricing, but the difference is retailers get to see what’s in the cart. It’s a lot harder to shoplift by pretending to scan an item when the cart is watching and making a record of what goes in and out.

Imagr offers a white-label solution for retailers that they can own, operate and scale themselves. This means the retailer would own all the hardware, software and the white-labeled app. Imagr has a shared licensing agreement for data with retailers because it needs to get smarter and keep training its models. Lamb said that Imagr hopes to offer inventory analytics in the future to help retailers avoid inventory distortion. 

“Our intention would be to essentially provide them the ability to track everything that comes in and out,” said Lamb. “In a perfect world, like, I don’t know all the Coke sells out, and it pings one of the retail workers in the store and she’s got to restock shelf 7A. That’s what we’re working towards. We don’t have a hard solution for it but there’s definitely demand for that.”

Corrections: A previous version of this article stated Shopic used barcode scanners but has since been updated with the correct information. This article has been updated to reflect that Amazon’s “Just Walk Out” technology is expanding internationally via its Amazon Go and Amazon Fresh stores. 

6 tips for establishing your startup’s global supply chain

More TechCrunch

OpenAI’s chatbot ChatGPT has been down for several users across the globe for the last few hours.

ChatGPT is down for several users, OpenAI is working on a fix

Microsoft’s education-focused flavor of its cloud productivity suite, Microsoft 365 Education, is facing investigation in the European Union where privacy rights non-profit noyb has just lodged two complaints with Austria’s…

Microsoft hit with EU privacy complaints over schools’ use of 365 Education suite

Since the shock of Russia’s 2022 invasion of Ukraine, solar energy has been having a moment in Europe. Electricity prices have been going up while the investment required to get…

Samara is accelerating the energy transition in Spain one solar panel at a time

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

11 hours ago
DEI backlash: Stay up-to-date on the latest legal and corporate challenges

The keynote will be focused on Apple’s software offerings and the developers that power them, including the latest versions of iOS, iPadOS, macOS, tvOS, visionOS and watchOS.

Watch Apple kick off WWDC 2024 right here

Hello and welcome back to TechCrunch Space. Unfortunately, Boeing’s Starliner launch was delayed yet again, this time due to issues with one of the three redundant computers used by United…

TechCrunch Space: China’s victory

The court ruling said that Fearless Fund’s Strivers Grant likely violates the Civil Rights Act of 1866, which bans the use of race in contracts.

An appeals court rules that VC Fearless Fund cannot issue grants to Black women, but the fight continues

Instagram Threads is rolling out the ability for users to signal which sort of posts they wanted to see more or less of by swiping.

You can now customize your For You feed on Threads using swipes

The Japanese billionaire who commissioned SpaceX for a private mission around the moon on a Starship rocket has abruptly canceled the project, citing ongoing uncertainties around when the launch vehicle…

Japanese billionaire pulls plug on private ‘dearMoon’ lunar Starship mission

Malicious actors are abusing generative AI music tools to create homophobic, racist, and propagandic songs — and publishing guides instructing others how to do so. According to ActiveFence, a service…

People are using AI music generators to create hateful songs

As WWDC 2024 nears, all sorts of rumors and leaks have emerged about what iOS 18 and its AI-powered apps and features have in store.

What to expect from Apple’s AI-powered iOS 18 at WWDC

Dallas is the second city that Cruise is easing its way back into after pulling its entire U.S. fleet late last year.

GM’s Cruise is testing robotaxis in Dallas again

Featured Article

After raising $100M, AI fintech LoanSnap is being sued, fined, evicted

The company has been sued by at least seven creditors, including Wells Fargo.

15 hours ago
After raising $100M, AI fintech LoanSnap is being sued, fined, evicted

Featured Article

Sonos Ace review: A high-priced contender

The Ace are a contender in a crowded market, but they’re still in search of that magic bullet to truly let them stand out from the pack.

15 hours ago
Sonos Ace review: A high-priced contender

The change would see Instagram becoming more like the free version of YouTube, which requires users to view ads before and in the middle of watching videos.

Instagram confirms test of ‘unskippable’ ads

Commerce platform Shopify has acquired Checkout Blocks, allowing Shopify Plus merchants to make no-code customizations in their checkout to enhance customer experience and potentially boost sales.  Checkout Blocks, which debuted…

Shopify acquires Checkout Blocks, a checkout customization app

After the Digital Markets Act (DMA) forced Apple to allow third-party app stores for iOS in Europe, several developers have launched alternative stores, like the AltStore and MacPaw’s Setapp (currently…

Aptoide launches its alternative iOS game store in the EU

Time is relentless and, right now, it’s no friend to procrastination-prone early-stage startup founders. The application window for Startup Battlefield 200 (SB 200) at TechCrunch Disrupt 2024 slams shut in…

One week left: Apply to TC Disrupt Startup Battlefield 200

Cloudera, the once high-flying Hadoop startup, raised $1 billion and went public in 2018 before being acquired by private equity for $5.3 billion in 2021. Today, the company announced that…

Cloudera acquires Verta to bring some AI chops to its data platform

The global spend management sector is experiencing a tailwind of sorts. North America is arguably the biggest market in this space, but spend management companies have seen demand rise across…

Spend management startup SiFi raises $10M to grow further in Saudi Arabia

Neural Concept lets designers model how components will perform before they can be manufactured.

Swiss startup Neural Concept raises $27M to cut EV design time to 18 months

The StrictlyVC roadtrip continues! Coming off of sold-out events in London, Los Angeles, and San Francisco, we’re heading to Washington, D.C. for a cozy-vc-packed, evening at the Woolly Mammoth Theatre…

Don’t miss StrictlyVC in DC next week

X will now allow users to post consensually produced NSFW content as long as it is prominently labeled as such.

X tweaks rules to formally allow adult content

Ashby consolidates existing talent acquisition tools and leans heavily on AI to automate the more repetitive steps in the recruitment pipeline.

Ashby injects recruiting with a dose of AI

Spotify has announced it’s hiking subscriptions for customers in the U.S., the second such price increase in the space of a year. The music-streaming giant reports that premium pricing will…

Spotify to increase premium pricing in the US to $11.99 per month

Monzo has announced its 2024 financial results, revealing its first full-year pre-tax profit. The company also confirmed that it’s in the early stages of expanding into the broader European market…

UK neobank Monzo reports first full (pre-tax) profit, prepares for EU expansion with Dublin hub

Featured Article

Inside Apple’s efforts to build a better recycling robot

Last week, TechCrunch paid a visit to Apple’s Austin, Texas, manufacturing facilities. Since 2013, the company has built its Mac Pro desktop about 20 minutes north of downtown. The 400,000-square-foot facility sits in a maze of industry parks, a quick trip south from the company’s in-progress corporate campus. In recent years, the capital city has…

1 day ago
Inside Apple’s efforts to build a better recycling robot

Early attempts at making dedicated hardware to house artificial intelligence smarts have been criticized as, well, a bit rubbish. But here’s an AI gadget-in-the-making that’s all about rubbish, literally: Finnish…

Binit is bringing AI to trash

Temasek has previously invested in Lenskart, and this new funding follows a $500 million investment by the Abu Dhabi Investment Authority last year.

Temasek, Fidelity buy $200M stake in Lenskart at $5B valuation

Less than one year after its iOS launch, French startup ten ten has gone viral with a walkie talkie app that allows teens to send voice messages to their close…

French startup ten ten reinvents the walkie-talkie