AI

Amazon turns to AI to help customers find clothes that fit when shopping online

Comment

amazon fashion ai customer fit
Image Credits: Amazon

After recently turning to generative AI to enhance its product reviews, e-commerce giant Amazon today shared how it’s now using AI technology to help customers shop for apparel online. The company explains it’s now using large language models, generative AI and machine learning to power four AI-powered features that will help customers find clothing that fits — an ongoing challenge when shopping online and the leading cause for apparel returns.

According to a study by Coresight Research, the average return rate for clothing ordered online is 24.4%, which is eight percentage points higher than the overall online return rate. In addition, retailers and brands said online returns had grown over the past two years. Often, that’s in part because today’s consumers will buy an item in multiple sizes or colors and then return those that don’t work out, as the process of home try-ons and shipping items back has become easier.

To address this challenge, Amazon has introduced AI into the online shopping experience in four ways: in personalized size recommendations, a “Fit Insights” tool for sellers, AI-powered highlights from fit reviews left by other customers and reimagined size charts.

With the personalized size recommendations, Amazon Fashion used AI to develop a deep learning algorithm that will help customers find their best-fitting size across a variety of styles.

This system works by considering the size relationship between brands’ size systems, the product’s reviews and the customer’s own fit preferences. The information is combined in real-time to make suggestions of the best-fitting size for a customer and adapts as the customer’s size needs change. The company also uses AI to help them discover the styles that fit them best. However, this feature can be imperfect if a family member regularly shops for another — like their teen son or daughter — as it confuses the system as to what size the customer is versus the child. (Amazon says this would not occur if the customer was browsing a children’s department versus an adult’s; it also notes that customers can create separate profiles for fit preferences through the “find your size” feature.)

Image Credits: Amazon

Another new feature, “Fit Review Highlights,” could help combat that problem, however. This feature is an extension of the newly added AI-generated Customer Review Highlights introduced in August 2023, which provide a short paragraph summary that details the customer sentiment and product features, as well as provides key product attributes as clickable buttons.

Image Credits: Amazon

With the Fit Review Highlights, Amazon extracts information about the apparel’s fit from the customer reviews, including things like size accuracy, garment fit on specific body areas and fabric stretch. Large language models extract details from the customer reviews and then AI summarizes the findings into an easy-to-read highlight personalized to the user, Amazon explains. This could help save users time as they wouldn’t have to read through hundreds of reviews to get a sense of the item’s fit.

The retailer is also now leveraging AI to improve size charts across the site. With large language models, Amazon Fashion is extracting and cleaning product size charts from multiple sources and then transforming the data into standardized sizes. This process will remove duplicate information and auto-correct missing or incorrect measurements, leading to more accurate charts — and therefore, fit.

Image Credits: Amazon

Sellers, too, will gain access to AI-powered insights. With a Fit Insights Tool from Amazon Fashion, sellers are provided with an understanding of a customer’s fit needs so they can improve how they communicate sizing to customers — e.g. “true to size,” or if an item runs smaller or larger, for instance.

This information can also be used to guide their future manufacturing efforts, Amazon notes. In this case, large language models are used to extract and aggregate customer feedback on fit, style and fabric in addition to returns, size chart analyses and customer reviews. Machine learning is also used to identify errors in the brand’s size charts, if any.

Image Credits: Amazon

These features are only a handful of AI advances that Amazon has employed AI to improve the shopping experience on its site in recent months. Beyond the customer review highlights, Amazon also debuted generative AI tools to help sellers write their product descriptions and enhance their product images. The latter could boost click-through rates by 40%, the retailer estimated at the time. Outside of Amazon Web Services, the company also brought AI to other consumer products, including Alexa and Fire TV.

More TechCrunch

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Everything announced so far

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google gets serious about AI-generated video at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls

The standard Gemma models were only available in 2 billion and 7 billion parameter versions, making this quite a step up.

Google announces Gemma 2, a 27B-parameter version of its open model, launching in June

This is a great example of a company using generative AI to open its software to more users.

Google TalkBack will use Gemini to describe images for blind people

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

Google’s Circle to Search feature will now be able to solve more complex problems across psychics and math word problems. 

Circle to Search is now a better homework helper

People can now search using a video they upload combined with a text query to get an AI overview of the answers they need.

Google experiments with using video to search, thanks to Gemini AI

A search results page based on generative AI as its ranking mechanism will have wide-reaching consequences for online publishers.

Google will soon start using GenAI to organize some search results pages

Google has built a custom Gemini model for search to combine real-time information, Google’s ranking, long context and multimodal features.

Google is adding more AI to its search results

At its Google I/O developer conference, Google on Tuesday announced the next generation of its Tensor Processing Units (TPU) AI chips.

Google’s next-gen TPUs promise a 4.7x performance boost

Google is upgrading Gemini, its AI-powered chatbot, with features aimed at making the experience more ambient and contextually useful.

Google reveals plans for upgrading AI in the real world through Gemini Live at Google I/O 2024

Veo can generate few-seconds-long 1080p video clips given a text prompt.

Google’s image-generating AI gets an upgrade

At Google I/O, Google announced upgrades to Gemini 1.5 Pro, including a bigger context window. .

Google’s generative AI can now analyze hours of video

The AI upgrade will make finding the right content more intuitive and less of a manual search process.

Google Photos introduces an AI search feature, Ask Photos

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8B in App Store fraud last year in latest pitch to developers

Online travel agency Expedia is testing an AI assistant that bolsters features like search, itinerary building, trip planning, and real-time travel updates.

Expedia starts testing AI-powered features for search and travel planning

Welcome to TechCrunch Fintech! This week, we look at the drama around TabaPay deciding to not buy Synapse’s assets, as well as stocks dropping for a couple of fintechs, Monzo raising…

Inside TabaPay’s drama-filled decision to abandon its plans to buy Synapse’s assets

The person who claimed to have stolen the physical addresses of 49 million Dell customers appears to have taken more data from a different Dell portal, TechCrunch has learned. The…

Threat actor scraped Dell support tickets, including customer phone numbers

If you write the words “cis” or “cisgender” on X, you might be served this full-screen message: “This post contains language that may be considered a slur by X and…

On Elon’s whim, X now treats ‘cisgender’ as a slur

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch the AI reveals live

Facebook once had big ambitions to be a major player in enterprise communication and productivity, but today the social network’s parent company Meta will be closing a very significant chapter…

Meta is shutting down Workplace, its enterprise communications business

The Oversight Board has overturned Meta’s decision to take down a documentary revealing the identities of child abuse victims in Pakistan.

Meta’s Oversight Board overturns takedown decision for Pakistan child abuse documentary

Adam Selipsky is stepping down from his role as CEO of Amazon Web Services, Amazon has confirmed to TechCrunch.  In a memo shared internally by Amazon CEO Andy Jassy and…

AWS CEO Adam Selipsky steps down