AI

LiveKit co-founder believes the metaverse needs open infrastructure

Comment

Image Credits: NurPhoto / Contributor / Getty Images

When the global pandemic hit, Russell d’Sa was running product at Medium and recognized early on that with everyone working from home, the company’s culture was impacted, affecting a lot of the interaction between employees.

“What disappeared was the collegial conversations, the drinks on Friday evenings or making coffee together,” he told TechCrunch. “So much about becoming friends at work underpins how you ultimately collaborate.”

When Clubhouse was launched in its alpha form last year, it was discussed as being a new form of participatory media “that would change everything,” d’Sa said, and he wanted something like that for his work colleagues.

He dug into how the app was being powered by Agora and began developing a desktop app for his idea. He launched it and almost immediately accrued a 1,300-company waitlist. D’Sa ultimately shelved the app, but found that companies were “desperate in this new environment to try anything.”

In fact, one large social media company approached him about using his app for its 1,000-person company, but was concerned about security using Agora. He began looking at alternatives, but found that many were focused on conferencing and didn’t provide for the flexibility for native mobile.

That’s how LiveKit was born. D’Sa and his team, which includes co-founder David Zhao, developed a free, open source infrastructure for building and scaling real-time audio and video experiences, aka WebRTC, in applications.

It launched in July, and today the company announced $7 million in seed funding that includes backing from Redpoint Ventures and a group of individual investors, including Justin Kan, Robin Chan and Elad Gil.

Only five months old, the tool did trend on GitHub, going from zero to almost 2,000 stars, d’Sa said. It is also proving product market fit, especially as more talk revolved around the metaverse.

“COVID changed the world to where we are living online, even going to weddings over the internet,” he added. “We are already living in the metaverse and have been for over two years.”

He believes the conference call is not the future and that virtual and augmented reality will make calls feel more like real life. However, the challenge is how to move the data around quickly over the internet and have an infrastructure that works for cameras, microphones and 3D objects.

Initial use cases for LiveKit’s live audio and video experiences have been cameras at events, but a drone company is even using the technology. As the company saw more adoption, including over 100 projects utilizing LiveKit, d’Sa decided to go after venture capital backing to scale the team, which grew from three to 15 since the launch.

The company isn’t generating revenue right now, but they will be as new tools come online, like services offered beyond the baseline features, including analytics, telemetry, spam and abuse monitoring, transcription, translations or voice and face features.

Next up, the LiveKit team will be focused on technology development so the tools are more reliable, flexible and accessible to developers and the kinds of use cases they are building.

“The goal is to figure out a way to work, even with a bad network,” d’Sa said. “We talk to companies big and small, and the largest companies want massive scale to make million-person events all interactive.”

Investor survey results: Upcoming trends in social startups

More TechCrunch

Google on Thursday said it is rolling out NotebookLM, its AI-powered note-taking assistant, to over 200 new countries, nearly six months after opening its access in the U.S. The platform,…

Google’s updated AI-powered NotebookLM expands to India, UK and over 200 other countries

Inflation and currency devaluation have always been a growing concern for Africans with bank accounts.

Once serving war-torn Sudan, YC-backed Elevate now provides fintech to freelancers globally

Featured Article

Amazon buys Indian video streaming service MX Player

Amazon has agreed to acquire assets of Indian video streaming service MX Player from the local media powerhouse Times Internet, the latest step by the e-commerce giant to make its services and brand popular in smaller cities and towns in the key overseas market.  The two firms reached a definitive…

3 hours ago
Amazon buys Indian video streaming service MX Player

Dealt is now building a service platform for retailers instead of end customers.

Dealt turns retailers into service providers and proves that pivots sometimes work

Snowflake is the latest company in a string of high-profile security incidents and sizable data breaches caused by the lack of MFA.

Hundreds of Snowflake customer passwords found online are linked to info-stealing malware

The buy will benefit ChromeOS, Google’s lightweight Linux-based operating system, by giving ChromeOS users greater access to Windows apps “without the hassle of complex installations or updates.”

Google acquires Cameyo to bring Windows apps to ChromeOS

Mistral is no doubt looking to grow revenue as it faces considerable — and growing — competition in the generative AI space.

Mistral launches new services and SDK to let customers fine-tune its models

The warning for the Ai Pin was issued “out of an abundance of caution,” according to Humane.

Humane urges customers to stop using charging case, citing battery fire concerns

The keynote will be focused on Apple’s software offerings and the developers that power them, including the latest versions of iOS, iPadOS, macOS, tvOS, visionOS and watchOS.

Watch Apple kick off WWDC 2024 right here

As WWDC 2024 nears, all sorts of rumors and leaks have emerged about what iOS 18 and its AI-powered apps and features have in store.

What to expect from Apple’s AI-powered iOS 18 at WWDC 2024

Welcome to Elon Musk’s X. The social network formerly known as Twitter where the rules are made up and the check marks don’t matter. Or do they? The Tesla and…

Elon Musk’s X: A complete timeline of what Twitter has become

TechCrunch has kept readers informed regarding Fearless Fund’s courtroom battle to provide business grants to Black women. Today, we are happy to announce that Fearless Fund CEO and co-founder Arian…

Fearless Fund’s Arian Simone coming to Disrupt 2024

Bridgy Fed is one of the efforts aimed at connecting the fediverse with the web, Bluesky and, perhaps later, other networks like Nostr.

Bluesky and Mastodon users can now talk to each other with Bridgy Fed

Zoox, Amazon’s self-driving unit, is bringing its autonomous vehicles to more cities.  The self-driving technology company announced Wednesday plans to begin testing in Austin and Miami this summer. The two…

Zoox to test self-driving cars in Austin and Miami 

Called Stable Audio Open, the generative model takes a text description and outputs a recording up to 47 seconds in length.

Stability AI releases a sound generator

It’s not just instant-delivery startups that are struggling. Oda, the Norway-based online supermarket delivery startup, has confirmed layoffs of 150 jobs as it drastically scales back its expansion ambitions to…

SoftBank-backed grocery startup Oda lays off 150, resets focus on Norway and Sweden

Newsletter platform Substack is introducing the ability for writers to send videos to their subscribers via Chat, its private community feature, the company announced on Wednesday. The rollout of video…

Substack brings video to its Chat feature

Hiya, folks, and welcome to TechCrunch’s inaugural AI newsletter. It’s truly a thrill to type those words — this one’s been long in the making, and we’re excited to finally…

This Week in AI: Ex-OpenAI staff call for safety and transparency

Ms. Rachel isn’t a household name, but if you spend a lot of time with toddlers, she might as well be a rockstar. She’s like Steve from Blues Clues for…

Cameo fumbles on Ms. Rachel fundraiser as fans receive credits instead of videos  

Cartwheel helps animators go from zero to basic movement, so creating a scene or character with elementary motions like taking a step, swatting a fly or sitting down is easier.

Cartwheel generates 3D animations from scratch to power up creators

The new tool, which is set to arrive in Wix’s app builder tool this week, guides users through a chatbot-like interface to understand the goals, intent and aesthetic of their…

Wix’s new tool taps AI to generate smartphone apps

ClickUp Knowledge Management combines a new wiki-like editor and with a new AI system that can also bring in data from Google Drive, Dropbox, Confluence, Figma and other sources.

ClickUp wants to take on Notion and Confluence with its new AI-based Knowledge Base

New York City, home to over 60,000 gig delivery workers, has been cracking down on cheap, uncertified e-bikes that have resulted in battery fires across the city.  Some e-bike providers…

Whizz wants to own the delivery e-bike subscription space, starting with NYC

This is the last major step before Starliner can be certified as an operational crew system, and the first Starliner mission is expected to launch in 2025. 

Boeing’s Starliner astronaut capsule is en route to the ISS 

TechCrunch Disrupt 2024 in San Francisco is the must-attend event for startup founders aiming to make their mark in the tech world. This year, founders have three exciting ways to…

Three ways founders can shine at TechCrunch Disrupt 2024

Google’s newest startup program, announced on Wednesday, aims to bring AI technology to the public sector. The newly launched “Google for Startups AI Academy: American Infrastructure” will offer participants hands-on…

Google’s new startup program focuses on bringing AI to public infrastructure

eBay’s newest AI feature allows sellers to replace image backgrounds with AI-generated backdrops. The tool is now available for iOS users in the U.S., U.K., and Germany. It’ll gradually roll…

eBay debuts AI-powered background tool to enhance product images

If you’re anything like me, you’ve tried every to-do list app and productivity system, only to find yourself giving up sooner rather than later because managing your productivity system becomes…

Hoop uses AI to automatically manage your to-do list

Asana is using its work graph to train LLMs with the goal of creating AI assistants that work alongside human employees in company workflows.

Asana introduces ‘AI teammates’ designed to work alongside human employees

Taloflow, an early stage startup changing the way companies evaluate and select software, has raised $1.3M in a seed round.

Taloflow puts AI to work on software vendor selection to reduce costs and save time