AI

LiveKit co-founder believes the metaverse needs open infrastructure

Comment

Image Credits: NurPhoto / Contributor / Getty Images

When the global pandemic hit, Russell d’Sa was running product at Medium and recognized early on that with everyone working from home, the company’s culture was impacted, affecting a lot of the interaction between employees.

“What disappeared was the collegial conversations, the drinks on Friday evenings or making coffee together,” he told TechCrunch. “So much about becoming friends at work underpins how you ultimately collaborate.”

When Clubhouse was launched in its alpha form last year, it was discussed as being a new form of participatory media “that would change everything,” d’Sa said, and he wanted something like that for his work colleagues.

He dug into how the app was being powered by Agora and began developing a desktop app for his idea. He launched it and almost immediately accrued a 1,300-company waitlist. D’Sa ultimately shelved the app, but found that companies were “desperate in this new environment to try anything.”

In fact, one large social media company approached him about using his app for its 1,000-person company, but was concerned about security using Agora. He began looking at alternatives, but found that many were focused on conferencing and didn’t provide for the flexibility for native mobile.

That’s how LiveKit was born. D’Sa and his team, which includes co-founder David Zhao, developed a free, open source infrastructure for building and scaling real-time audio and video experiences, aka WebRTC, in applications.

It launched in July, and today the company announced $7 million in seed funding that includes backing from Redpoint Ventures and a group of individual investors, including Justin Kan, Robin Chan and Elad Gil.

Only five months old, the tool did trend on GitHub, going from zero to almost 2,000 stars, d’Sa said. It is also proving product market fit, especially as more talk revolved around the metaverse.

“COVID changed the world to where we are living online, even going to weddings over the internet,” he added. “We are already living in the metaverse and have been for over two years.”

He believes the conference call is not the future and that virtual and augmented reality will make calls feel more like real life. However, the challenge is how to move the data around quickly over the internet and have an infrastructure that works for cameras, microphones and 3D objects.

Initial use cases for LiveKit’s live audio and video experiences have been cameras at events, but a drone company is even using the technology. As the company saw more adoption, including over 100 projects utilizing LiveKit, d’Sa decided to go after venture capital backing to scale the team, which grew from three to 15 since the launch.

The company isn’t generating revenue right now, but they will be as new tools come online, like services offered beyond the baseline features, including analytics, telemetry, spam and abuse monitoring, transcription, translations or voice and face features.

Next up, the LiveKit team will be focused on technology development so the tools are more reliable, flexible and accessible to developers and the kinds of use cases they are building.

“The goal is to figure out a way to work, even with a bad network,” d’Sa said. “We talk to companies big and small, and the largest companies want massive scale to make million-person events all interactive.”

Investor survey results: Upcoming trends in social startups

More TechCrunch

Pinecone, the vector database startup founded by Edo Liberty, the former head of Amazon’s AI Labs, has long been at the forefront of helping businesses augment large language models (LLMs)…

Pinecone launches its serverless vector database out of preview

Young geothermal energy wells can be like budding prodigies, each brimming with potential to outshine their peers. But like people, most decline with age. In California, for example, the amount…

Special mud helps XGS Energy get more power out of geothermal wells

The market play is clear from the outset: The $449 headphones are firmly targeted at an audience that would otherwise be purchasing the Bose QC Ultra or Apple AirPods Max.

Sonos finally made some headphones

Adobe says the feature is up to the task, regardless of how complex of a background the object is set against.

Adobe brings Firefly AI-powered Generative Remove to Lightroom

All cars suffer when the mercury drops, but electric vehicles suffer more than most as heaters draw more power and batteries charge more slowly as the liquid electrolyte inside thickens.…

Porsche invests in battery startup South 8 to boost cold-weather EV performance

Scale AI has raised a $1 billion Series F round from a slew of big-name institutional and corporate investors including Amazon and Meta.

Data-labeling startup Scale AI raises $1B as valuation doubles to $13.8B

The new coalition, Tech Against Scams, will work together to find ways to fight back against the tools used by scammers and to better educate the public against financial scams.

Meta, Match, Coinbase and others team up to fight online fraud and crypto scams

It’s a wrap: European Union lawmakers have given the final approval to set up the bloc’s flagship, risk-based regulations for artificial intelligence.

EU Council gives final nod to set up risk-based regulations for AI

London-based fintech Vitesse has closed a $93 million Series C round of funding led by investment giant KKR.

Vitesse, a payments and treasury management platform for insurers, raises $93M to fuel US expansion

Zen Educate, an online marketplace that connects schools with teachers, has raised $37 million in a Series B round of funding. The raise comes amid a growing teacher shortage crisis…

Zen Educate raises $37M and acquires Aquinas Education as it tries to address the teacher shortage

“When I heard the released demo, I was shocked, angered and in disbelief that Mr. Altman would pursue a voice that sounded so eerily similar to mine.”

Scarlett Johansson says that OpenAI approached her to use her voice

A new self-driving truck — manufactured by Volvo and loaded with autonomous vehicle tech developed by Aurora Innovation — could be on public highways as early as this summer.  The…

Aurora and Volvo unveil self-driving truck designed for a driverless future

The European venture capital firm raised its fourth fund as fund as climate tech “comes of age.”

ETF Partners raises €285M for climate startups that will be effective quickly — not 20 years down the road

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Hello and welcome back to TechCrunch Space. For those who haven’t heard, the first crewed launch of Boeing’s Starliner capsule has been pushed back yet again to no earlier than…

TechCrunch Space: Star(side)liner

When I attended Automate in Chicago a few weeks back, multiple people thanked me for TechCrunch’s semi-regular robotics job report. It’s always edifying to get that feedback in person. While…

These 81 robotics companies are hiring

The top vehicle safety regulator in the U.S. has launched a formal probe into an April crash involving the all-electric VinFast VF8 SUV that claimed the lives of a family…

VinFast crash that killed family of four now under federal investigation

When putting a video portal in a public park in the middle of New York City, some inappropriate behavior will likely occur. The Portal, the vision of Lithuanian artist and…

NYC-Dublin real-time video portal reopens with some fixes to prevent inappropriate behavior

Longtime New York-based seed investor, Contour Venture Partners, is making progress on its latest flagship fund after lowering its target. The firm closed on $42 million, raised from 64 backers,…

Contour Venture Partners, an early investor in Datadog and Movable Ink, lowers the target for its fifth fund

Meta’s Oversight Board has now extended its scope to include the company’s newest platform, Instagram Threads, and has begun hearing cases from Threads.

Meta’s Oversight Board takes its first Threads case

The company says it’s refocusing and prioritizing fewer initiatives that will have the biggest impact on customers and add value to the business.

SeekOut, a recruiting startup last valued at $1.2 billion, lays off 30% of its workforce

The U.K.’s self-proclaimed “world-leading” regulations for self-driving cars are now official, after the Automated Vehicles (AV) Act received royal assent — the final rubber stamp any legislation must go through…

UK’s autonomous vehicle legislation becomes law, paving the way for first driverless cars by 2026

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

SoLo Funds CEO Travis Holoway: “Regulators seem driven by press releases when they should be motivated by true consumer protection and empowering equitable solutions.”

Fintech lender SoLo Funds is being sued again by the government over its lending practices

Hard tech startups generate a lot of buzz, but there’s a growing cohort of companies building digital tools squarely focused on making hard tech development faster, more efficient and —…

Rollup wants to be the hardware engineer’s workhorse

TechCrunch Disrupt 2024 is not just about groundbreaking innovations, insightful panels, and visionary speakers — it’s also about listening to YOU, the audience, and what you feel is top of…

Disrupt Audience Choice vote closes Friday

Google says the new SDK would help Google expand on its core mission of connecting the right audience to the right content at the right time.

Google is launching a new Android feature to drive users back into their installed apps

Jolla has taken the official wraps off the first version of its personal server-based AI assistant in the making. The reborn startup is building a privacy-focused AI device — aka…

Jolla debuts privacy-focused AI hardware

The ChatGPT mobile app’s net revenue first jumped 22% on the day of the GPT-4o launch and continued to grow in the following days.

ChatGPT’s mobile app revenue saw its biggest spike yet following GPT-4o launch

Dating app maker Bumble has acquired Geneva, an online platform built around forming real-world groups and clubs. The company said that the deal is designed to help it expand its…

Bumble buys community building app Geneva to expand further into friendships