AI

LiveKit co-founder believes the metaverse needs open infrastructure

Comment

Image Credits: NurPhoto / Contributor / Getty Images

When the global pandemic hit, Russell d’Sa was running product at Medium and recognized early on that with everyone working from home, the company’s culture was impacted, affecting a lot of the interaction between employees.

“What disappeared was the collegial conversations, the drinks on Friday evenings or making coffee together,” he told TechCrunch. “So much about becoming friends at work underpins how you ultimately collaborate.”

When Clubhouse was launched in its alpha form last year, it was discussed as being a new form of participatory media “that would change everything,” d’Sa said, and he wanted something like that for his work colleagues.

He dug into how the app was being powered by Agora and began developing a desktop app for his idea. He launched it and almost immediately accrued a 1,300-company waitlist. D’Sa ultimately shelved the app, but found that companies were “desperate in this new environment to try anything.”

In fact, one large social media company approached him about using his app for its 1,000-person company, but was concerned about security using Agora. He began looking at alternatives, but found that many were focused on conferencing and didn’t provide for the flexibility for native mobile.

That’s how LiveKit was born. D’Sa and his team, which includes co-founder David Zhao, developed a free, open source infrastructure for building and scaling real-time audio and video experiences, aka WebRTC, in applications.

It launched in July, and today the company announced $7 million in seed funding that includes backing from Redpoint Ventures and a group of individual investors, including Justin Kan, Robin Chan and Elad Gil.

Only five months old, the tool did trend on GitHub, going from zero to almost 2,000 stars, d’Sa said. It is also proving product market fit, especially as more talk revolved around the metaverse.

“COVID changed the world to where we are living online, even going to weddings over the internet,” he added. “We are already living in the metaverse and have been for over two years.”

He believes the conference call is not the future and that virtual and augmented reality will make calls feel more like real life. However, the challenge is how to move the data around quickly over the internet and have an infrastructure that works for cameras, microphones and 3D objects.

Initial use cases for LiveKit’s live audio and video experiences have been cameras at events, but a drone company is even using the technology. As the company saw more adoption, including over 100 projects utilizing LiveKit, d’Sa decided to go after venture capital backing to scale the team, which grew from three to 15 since the launch.

The company isn’t generating revenue right now, but they will be as new tools come online, like services offered beyond the baseline features, including analytics, telemetry, spam and abuse monitoring, transcription, translations or voice and face features.

Next up, the LiveKit team will be focused on technology development so the tools are more reliable, flexible and accessible to developers and the kinds of use cases they are building.

“The goal is to figure out a way to work, even with a bad network,” d’Sa said. “We talk to companies big and small, and the largest companies want massive scale to make million-person events all interactive.”

Investor survey results: Upcoming trends in social startups

More TechCrunch

TikTok is the latest tech company to incorporate generative AI into its ads business, as the company announced on Tuesday that it’s launching a new “TikTok Symphony” AI suite for…

TikTok turns to generative AI to boost its ads business

Gone are the days when space and defense were considered fundamentally antithetical to venture investment. Now, the country’s largest venture capital firms are throwing larger portions of their money behind…

Space VC closes $20M Fund II to back frontier tech founders from day zero

These days every company is trying to figure out if their large language models are compliant with whatever rules they deem important, and with legal or regulatory requirements. If you’re…

Patronus AI is off to a magical start as LLM governance tool gains traction

Link-in-bio startup Linktree has crossed 50 million users and is rolling out the beta of its social commerce program.

Linktree surpasses 50M users, rolls out its social commerce program to more creators

For a $5.99 per month, immigrants have a bank account and debit card with fee-free international money transfers and discounted international calling.

Immigrant banking platform Majority secures $20M following 3x revenue growth

When developers have a particular job that AI can solve, it’s not typically as simple as just pointing an LLM at the data. There are other considerations such as cost,…

Unify helps developers find the best LLM for the job

Response time is Aerodome’s immediate value prop for potential clients.

Aerodome is sending drones to the scene of the crime

Granola takes a more collaborative approach to working with AI.

Granola debuts an AI notepad for meetings

DeepL, which builds automated text translation and writing tools, has raised a $300 million round led by Index Ventures.

AI language translation startup DeepL nabs $300M on a $2B valuation to focus on B2B growth

Praktika has secured a $35.5M Series A round to apply AI-powered avatars to language-learning apps.

Praktika raises $35.5M to use AI avatars to make learning languages feel more natural

Humane, the company behind the hyped Ai Pin that launched to less-than-glowing reviews last month, is reportedly on the hunt for a buyer.

Humane, the creator of the $700 Ai Pin, is reportedly seeking a buyer

India’s Oyo, once valued at $10 billion, has withdrawn its IPO application from the market regulator for the second time.

Oyo, once valued at $10 billion, shelves IPO plans for second time

Where Aytac Yilmaz lives in the Netherlands, the sun might not appear for days on end, which can really crimp the output of the country’s solar panels. Wind turbines might…

Ore Energy emerges from stealth to build utility-scale batteries that last days, not hours

Paytm, a leading financial services firm in India, said its net loss widened in the fourth quarter as it grappled with a regulatory clampdown.

Paytm warns of job cuts as losses swell after RBI clampdown

Government officials and AI industry executives agreed on Tuesday to apply elementary safety measures in the fast-moving field and establish an international safety research network. Nearly six months after the…

In Seoul summit, heads of states and companies commit to AI safety

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Some startups choose to bootstrap from the beginning while others find themselves forced into self funding by a lack of investor interest or a business model that doesn’t fit traditional…

VCs wanted FarmboxRx to become a meal kit, the company bootstrapped instead

Uber and Lyft drivers in Minnesota will see higher pay thanks to a deal between the state and the country’s two largest ride-hailing companies. The upshot: a new law that…

Uber’s and Lyft’s ride-hailing deal with Minnesota comes at a cost

Andreessen Horowitz’s American Dynamism fund has established a new fellowship program aimed at introducing top engineers and technologists to venture investing, a move that could help the firm identify less…

a16z’s American Dynamism team launches program to introduce technical minds to VC

Another fintech startup, and its customers, has been gravely impacted by the implosion of banking-as-a-service startup Synapse. Copper Banking, a digital banking service aimed at teens, notified its customers on…

Teen fintech Copper had to abruptly discontinue its banking, debit products

Autodesk — the 3D tools behemoth — has acquired Wonder Dynamics, a startup that lets creators quickly and easily make complex characters and visual effects using AI-powered image analysis. The…

Autodesk acquires AI-powered VFX startup Wonder Dynamics

Farcaster, a blockchain-based social protocol founded by two Coinbase alumni, announced on Tuesday that it closed a $150 million fundraise. Led by Paradigm, the platform also raised money from a16z…

Farcaster, a crypto-based social network, raised $150M with just 80K daily users

Microsoft announced on Tuesday during its annual Build conference that it’s bringing “Windows Volumetric Apps” to Meta Quest headsets. The partnership will allow Microsoft to bring Windows 365 and local…

Microsoft’s new ‘Volumetric Apps’ for Quest headsets extend Windows apps into the 3D space

The spam reached Bluesky by first crossing over two other decentralized networks: Mastodon and Nostr.

The ‘vote Trump’ spam that hit Bluesky in May came from decentralized rival Nostr

Welcome to TechCrunch Fintech! This week, we’re looking at the continued fallout from Synapse’s bankruptcy, how Layer wants to disrupt SMB accounting, and much more! To get a roundup of…

There’s a real appetite for a fintech alternative to QuickBooks

The company is hoping to produce electricity at $13 per megawatt hour, which would be more than 50% cheaper than traditional onshore wind.

Bill Gates-backed wind startup AirLoom is raising $12M, filings reveal

Generative AI makes stuff up. It can be biased. Sometimes it spits out toxic text. So can it be “safe”? Rick Caccia, the CEO of WitnessAI, believes it can. “Securing…

WitnessAI is building guardrails for generative AI models

It’s not often that you hear about a seed round above $10 million. H, a startup based in Paris and previously known as Holistic AI, has announced a $220 million…

French AI startup H raises $220M seed round

Hey there, Series A to B startups with $35 million or less in funding — we’ve got an exciting opportunity that’s tailor-made for your growth journey! If you’re looking to…

Boost your startup’s growth with a ScaleUp package at TC Disrupt 2024

TikTok is pulling out all the stops to prevent its impending ban in the United States. Aside from initiating legal action against the U.S. government, that means shaping up its…

As a US ban looms, TikTok announces a $1M program for socially driven creators