AI

SLAIT pivots from translating sign language to AI-powered interactive lessons

Comment

A kid learns sign language on SLAIT's online tutor site.
Image Credits: SLAIT

Millions of people use sign language, but the methods of teaching this complex and subtle skill haven’t evolved as quickly as those for written and spoken languages. SLAIT School aims to change that with an interactive tutor powered by computer vision, letting aspiring ASL speakers practice at their own rate like in any other language learning app.

SLAIT started back in 2021 as the sign language AI translator (hence the name): a real-time video chat and translation tool that could recognize most common signs and help an ASL speaker communicate more easily with someone who doesn’t know the language. But early successes slowed as the team realized they needed more time, money and data than they were likely to get.

“We got great results in the beginning, but after several attempts we realized that, right now, there just is not enough data to provide full language translation,” explained Evgeny Fomin, CEO and co-founder of SLAIT. “We had no opportunity for investment, no chance to find our supporters, because we were stuck without a product launch — we were in limbo. Capitalism… is hard.”

“But then we thought, what can we do with the tech we’ve got from R&D? We realized we needed to do an education solution, because for education our technology is definitely good enough,” he continued. Not that there are lower standards for people learning, but the fluidity and subtlety of fluent and mature sign language is orders of magnitude more difficult to capture and translate than one or two words at a time.

“We found an extremely talented guy (CTO Nikita Nikitin) who helped us develop a product, and we made SLAIT School. And now we have our first customers and some traction!”

Existing online sign language courses (here’s a solid list if you’re curious) are generally pretty traditional. You have lectures and demonstrations, vocabulary lists and illustrations, and if you pay for it online, you can have someone review your work over video. It’s high-quality and much of it is free but it isn’t the kind of interactive experience people have come to expect from apps like Duolingo.

SLAIT School uses an updated version of the gesture recognition tech that powered the translator demo app to provide instant feedback on words and phrases. See it in video form, then try it until you get it. Currently it’s for desktop browsers only, but the team is planning a mobile app as well.

“We have some room for improvement, but it’s exactly what we planned to deliver. Students can access the platform, do practice, make signs, interact with the AI tutor, and it costs them same as one hour with an in-person tutor,” said Fomin. “The mobile apps we aim to do for free.”

Users can do the first few lessons in order to see that the system works, then it’s $39 monthly, $174 half-yearly and $228 yearly. The price may seem high compared with large-scale language apps supported by capital and other business models, but Fomin emphasized this is a new and special category, and real-world tutors are their primary competition.

Image Credits: SLAIT School

“We actively communicate with users and try to find the best prices and economic model that makes subscription plans affordable. We would really like to make the platform free, but so far we have not found an opportunity for this yet. Because this is a very niche product… we just need to make a stable economic model that will work in general,” he said.

The traction is also a flywheel for the company’s tech and content. By collecting information (with express opt-in consent, which he says the community is quite happy to provide) they can expand and improve the curriculum, and continue to refine their gesture recognition engine.

“We see two directions for growing in,” Fomin said. “The first is to cover more language groups, like British sign language and Japanese sign language. Also we would like to make the curriculum more adaptive, or provide a curriculum for medical and scientific signs. If we have enough investment to grow and scale we can be a leading platform globally to automate talking to doctor in sign language.”

After that, he said, “Maybe we can finally develop a translator. We can break through this barrier!”

Acapela lets anyone back up their own voice for free in minutes — just in case

More TechCrunch

In addition to the federal funding, the state of New Mexico — where SolAero is based — committed to providing financing and incentives that value $25.5 million.

Biden administration looks to give Rocket Lab $24M to boost space-grade solar cell production

Some of the new Apple Intelligence features that Apple debuted at WWDC 2024 don’t even feel like AI, they just feel like smarter tools. 

Apple’s AI, Apple Intelligence, is boring and practical — that’s why it works

The TechCrunch team runs down all of the biggest news from the Apple WWDC 2024 keynote in an easy-to-skim digest.

Here’s everything Apple announced at the WWDC 2024 keynote, including Apple Intelligence, Siri makeover

Jordan Meyer and Mathew Dryhurst founded Spawning AI to create tools that help artists exert more control over how their works are used online. Their latest project, called Source.Plus, is…

Spawning wants to build more ethical AI training datasets

After leading the social media landscape, TikTok appears to be interested in challenging Google’s dominance in search. The company confirmed to TechCrunch that it’s testing the ability for users to…

TikTok comes for Google as it quietly rolls out image search capabilities in TikTok Shop

General Motors is investing $850 million into Cruise as the autonomous vehicle subsidiary slowly makes its way back to testing in Phoenix, Dallas and, as of Tuesday, Houston. GM’s CFO…

GM gives Cruise $850M lifeline as it relaunches robotaxis in Houston

These messaging features, announced at WWDC 2024, will have a significant impact on how people communicate every day.

At last, Apple’s Messages app will support RCS and scheduling texts

Welcome to TechCrunch Fintech! This week, we’re looking at Rippling’s controversial decision to ban some former employees from selling their stock, Carta’s massive valuation drop, a GenZ-focused fintech raise, and…

Rippling’s tender offer decision draws mixed — and strong — reactions

Google is finally making its Gemini Nano AI model available to Pixel 8 and 8a users after teasing it in March.

Google’s June Pixel feature drop brings Gemini Nano AI model to Pixel 8 and 8a users

At WWDC 2024, Apple introduced new options for developers to promote their apps and earn more from them in the App Store.

Apple adds win-back subscription offers and improved search suggestions to the App Store

iOS 18 will be available in the fall as a free software update.

Here are all the devices compatible with iOS 18

The acquisition comes as BeReal was struggling to grow its user base and was looking for a buyer.

BeReal is being acquired by mobile apps and games company Voodoo for €500M

Unlike Light’s older phones, the Light III sports a larger OLED display and an NFC chip to make way for future payment tools, as well as a camera.

Light introduces its latest minimalist phone, now with an OLED screen but still no addictive apps

Since April, a hacker with a history of selling stolen data has claimed a data breach of billions of records — impacting at least 300 million people — from a…

The mystery of an alleged data broker’s data breach

Diversity Spotlight is a feature on Crunchbase that lets companies add tags to their profiles to label themselves.

Crunchbase expands its diversity-tracking feature to Europe

Thanks to Apple’s newfound — and heavy — investment in generative AI tech, the company had loads to showcase on the AI front, from an upgraded Siri to AI-generated emoji.

The top AI features Apple announced at WWDC 2024

A Finnish startup called Flow Computing is making one of the wildest claims ever heard in silicon engineering: by adding its proprietary companion chip, any CPU can instantly double its…

Flow claims it can 100x any CPU’s power with its companion chip and some elbow grease

Five years ago, Day One Ventures had $11 million under management, and Bucher and her team have grown that to just over $450 million.

The VC queen of portfolio PR, Masha Bucher, has raised her largest fund yet: $150M

Particle announced it has partnered with news organization Reuters to collaborate on new business models and experiments in monetization.

AI news reader Particle adds publishing partners and $10.9M in new funding

Mistral AI has closed its much-rumored Series B funding round, raising €600 million (around $640 million) in a mix of equity and debt.

Paris-based AI startup Mistral AI raises $640M

Cognigy is helping create AI that can handle the highly repetitive, rote processes center workers face daily.

Cognigy lands cash to grow its contact center automation business

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

Featured Article

Raspberry Pi is now a public company

Raspberry Pi priced its IPO on the London Stock Exchange on Tuesday morning at £2.80 per share, valuing it at £542 million, or $690 million at today’s exchange rate.

11 hours ago
Raspberry Pi is now a public company

Hello and welcome back to TechCrunch Space. What a week! In the same seven-day period, we watched Boeing’s Starliner launch astronauts to space for the first time, and then we…

TechCrunch Space: A week that will go down in history

Elon Musk’s posts seem to misunderstand the relationship Apple announced with OpenAI at WWDC 2024.

Elon Musk threatens to ban Apple devices from his companies over Apple’s ChatGPT integrations

“We’re looking forward to doing integrations with other models, including Google Gemini, for instance, in the future,” Federighi said during WWDC 2024.

Apple confirms plans to work with Google’s Gemini ‘in the future’

When Urvashi Barooah applied to MBA programs in 2015, she focused her applications around her dream of becoming a venture capitalist. She got rejected from every school, and was told…

How Urvashi Barooah broke into venture after everyone told her she couldn’t

Slack CEO Denise Dresser is speaking at TechCrunch Disrupt 2024.

Slack CEO Denise Dresser is coming to TechCrunch Disrupt this October

Apple kicked off its weeklong Worldwide Developers Conference (WWDC 2024) event today with the customary keynote at 1 p.m. ET/10 a.m. PT. The presentation focused on the company’s software offerings…

Watch the Apple Intelligence reveal, and the rest of WWDC 2024 right here

Apple’s SDKs (software development kits) have been updated with a variety of new APIs and frameworks.

Apple brings its GenAI ‘Apple Intelligence’ to developers, will let Siri control apps