AI

Y Combinator-backed Poly uses AI to generate art assets

Comment

Futuristic digital blockchain background. Abstract connections technology and digital network. 3d illustration of the Big data and communications technology.
Image Credits: v_alex / Getty Images

As generative AI like ChatGPT and DALL-E 2 attract investor attention, startup entrepreneurs are looking to cash in with new business models built around them. One of the more interesting ventures to emerge from the space recently is Poly, which lets designers create video game and other virtual assets, including textures for 3D models, using only text prompts.

Poly is essentially a stock asset library along the lines of Adobe Stock and Shutterstock but populated exclusively by AI generations. While platforms like Getty Images have banned AI-generated content for fear of potential legal blowback, Poly is barreling full steam ahead.

“Almost everyone knows the all-too-common pain of searching for that perfect icon, illustration, font or sound effect online, only to give up and settle for something imperfect. Poly is trying to drastically improve this with a suite of generative tools focused on creators,” CEO Abhay Agarwal told TechCrunch in an email interview.

Before co-founding Poly with Sam Young, Agarwal was a research fellow at Microsoft, where he published papers in the field of AI for social impact. Agarwal then started Polytopal, a “human-centered AI” consulting company that worked with brands like Spotify, Meta and Nestlé to develop various intelligent systems. Among other projects, Polytopal co-created a dance choreography algorithm for the game BeatSaber and launched a virtual baking assistant for Toll House that helps design a cookie recipe to suit users’ dietary needs.

“Young and I started Poly in early 2022 from a shared passion to ‘increase the creative capacity of the world,’ and joined Y Combinator’s S22 batch,” Agarwal said.

Poly
Image Credits: Poly

Poly’s first tool in its planned web-based suite generates 3D textures with physically-based rendering maps. In modeling, “physically-based rendering” refers to a technique that aims to render images in a way that mimics the flow of light in the real world.

With Poly, designers can describe a texture (e.g. “Tree bark with moss”) and optionally provide a reference image to get generated textures for crafting 3D models. The models come in customizable resolutions and with normal and invert maps — maps often used in game development to add volume, depth and details to 3D objects’ surfaces.

“Poly trains its generative AI models with several proprietary methods, such as extracting texture information from normal images to augment its model’s learning capabilities,” Agarwal said.

When asked about how Poly treats more sensitive content that developers might request, like violent and overtly sexual generated imagery, Agarwal provided few details but said that Poly “carefully and responsibly” audits its products. “We’ve had no instances of harm reported to us yet,” he added.

Poly sees itself competing both with traditional asset marketplaces and developers’ manual design processes. Besides portals such as GameDev Market and OpenGameArt, major game engine vendors like Unity host and sell assets through their own platforms.

Poly’s also not the first to apply AI to generating game assets. Direct competitors include Hotpot and Pixela.ai, which use similar algorithms to create custom backgrounds, sprites and other art content.

Agarwal asserts that Poly’s generative AI is superior to most in terms of the quality of assets it produces. The jury’s out on that. But Poly aims to further differentiate itself by expanding its generative AI service across asset types such as illustrations, sprites, sound effects and more. It plans to make money through enterprise partnerships, premium integrations for design tools and by charging a subscription fee for royalty-free access to assets, including commercial and resale rights.

Agarwal claims that “thousands” of developers are currently using Poly’s free service, which generates an unlimited number of assets for noncommercial use, while “hundreds” are paying for Poly’s pro plan. To date, the platform has generated more than two million textures.

That momentum drew in investors, including Felicis, Bloomberg Beta, NextView Ventures, Y Combinator, Figma Ventures and the AI Grant, which together contributed $3.9 million in venture capital toward Poly at Y Combinator’s demo day in September.

“Poly’s customers range from professionals at Fortune 500 companies to individual freelancers in game design, AR/VR, interior design, architecture and 3D rendering for ecommerce and marketing,” Agarwal said. “Poly has a multi-year runway and can focus on building the best possible technology since a higher-quality product is required to stand out and win in this emerging and highly active space.”

Poly
Image Credits: Poly

Assuming Poly broadly catches on, it and its generative AI rivals run the risk of upsetting the artist community — not only because they might threaten livelihoods but because generative AI systems have been shown to regurgitate the data on which they were trained (e.g. existing art assets). On the art community portal ArtStation, which earlier this year began allowing AI-generated art on its platform for the first time, members began widely protesting by placing “No AI Art” images in their portfolios.

The alluded-to legal questions around the technology remain unresolved, as well. One class action lawsuit alleges that GitHub’s code-generating system, Copilot, regurgitates sections of licensed code without providing credit, which could have implications for art-generating AI systems as well as those that use art created by them. In an unrelated case, the U.S. Copyright Office recently ended copyright protection for a comic book created with generative AI after initially granting it, saying that only works created by humans are entitled to protection.

Agarwal isn’t concerned, though — or if he is, he isn’t showing it.

“Generative AI is facing a lot of criticism from creators and is being viewed as ‘anti-creator’ as many companies in this space want to replace creators with automated systems. However, Poly’s focus has always been to empower creators with easier access to design assets,” Agarwal said. “Building on its current momentum, Poly plans to continue its relentless focus on its proprietary generative AI innovation, model training and product development to support more types of design assets and be embedded into designers’ daily workflows.”

Poly has three employees at present, and plans to double its team in the next six-12 months.

More TechCrunch

AI has already started replacing voice agents’ jobs. Now, companies are exploring ways to replace the existing computer-generated voice models with synthetic versions of human voices. Truecaller, the widely known…

Truecaller partners with Microsoft to let its AI respond to calls in your own voice

Meta is updating its Ray-Ban smart glasses with new hands-free functionality, the company announced on Wednesday. Most notably, users can now share an image from their smart glasses directly to…

Meta’s Ray-Ban smart glasses now let you share images directly to your Instagram Story

Spotify launched its own font, the company announced on Wednesday. The music streaming service hopes that its new typeface, “Spotify Mix,” will help Spotify distinguish its own unique visual identity. …

Why Spotify is launching its own font, Spotify Mix

In 2008, Marty Kagan, who’d previously worked at Cisco and Akamai, co-founded Cedexis, a (now-Cisco-owned) firm developing observability tech for content delivery networks. Fellow Cisco veteran Hasan Alayli joined Kagan…

Hydrolix seeks to make storing log data faster and cheaper

A dodgy email containing a link that looks “legit” but is actually malicious remains one of the most dangerous, yet successful, tricks in a cyber criminal’s handbook. Now, an AI…

Bolster, creator of the CheckPhish phishing tracker, raises $14M led by Microsoft’s M12

If you’ve been looking forward to seeing Boeing’s Starliner capsule carry two astronauts to the International Space Station for the first time, you’ll have to wait a bit longer. The…

Boeing, NASA indefinitely delay crewed Starliner launch

TikTok is the latest tech company to incorporate generative AI into its ads business, as the company announced on Tuesday that it’s launching a new “TikTok Symphony” AI suite for…

TikTok turns to generative AI to boost its ads business

Gone are the days when space and defense were considered fundamentally antithetical to venture investment. Now, the country’s largest venture capital firms are throwing larger portions of their money behind…

Space VC closes $20M Fund II to back frontier tech founders from day zero

These days every company is trying to figure out if their large language models are compliant with whatever rules they deem important, and with legal or regulatory requirements. If you’re…

Patronus AI is off to a magical start as LLM governance tool gains traction

Link-in-bio startup Linktree has crossed 50 million users and is rolling out the beta of its social commerce program.

Linktree surpasses 50M users, rolls out its social commerce program to more creators

For a $5.99 per month, immigrants have a bank account and debit card with fee-free international money transfers and discounted international calling.

Immigrant banking platform Majority secures $20M following 3x revenue growth

When developers have a particular job that AI can solve, it’s not typically as simple as just pointing an LLM at the data. There are other considerations such as cost,…

Unify helps developers find the best LLM for the job

Response time is Aerodome’s immediate value prop for potential clients.

Aerodome is sending drones to the scene of the crime

Granola takes a more collaborative approach to working with AI.

Granola debuts an AI notepad for meetings

DeepL, which builds automated text translation and writing tools, has raised a $300 million round led by Index Ventures.

AI language translation startup DeepL nabs $300M on a $2B valuation to focus on B2B growth

Praktika has secured a $35.5M Series A round to apply AI-powered avatars to language-learning apps.

Praktika raises $35.5M to use AI avatars to make learning languages feel more natural

Humane, the company behind the hyped Ai Pin that launched to less-than-glowing reviews last month, is reportedly on the hunt for a buyer.

Humane, the creator of the $700 Ai Pin, is reportedly seeking a buyer

India’s Oyo, once valued at $10 billion, has withdrawn its IPO application from the market regulator for the second time.

Oyo, once valued at $10 billion, shelves IPO plans for second time

Where Aytac Yilmaz lives in the Netherlands, the sun might not appear for days on end, which can really crimp the output of the country’s solar panels. Wind turbines might…

Ore Energy emerges from stealth to build utility-scale batteries that last days, not hours

Paytm, a leading financial services firm in India, said its net loss widened in the fourth quarter as it grappled with a regulatory clampdown.

Paytm warns of job cuts as losses swell after RBI clampdown

Government officials and AI industry executives agreed on Tuesday to apply elementary safety measures in the fast-moving field and establish an international safety research network. Nearly six months after the…

In Seoul summit, heads of states and companies commit to AI safety

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Some startups choose to bootstrap from the beginning while others find themselves forced into self funding by a lack of investor interest or a business model that doesn’t fit traditional…

VCs wanted FarmboxRx to become a meal kit, the company bootstrapped instead

Uber and Lyft drivers in Minnesota will see higher pay thanks to a deal between the state and the country’s two largest ride-hailing companies. The upshot: a new law that…

Uber’s and Lyft’s ride-hailing deal with Minnesota comes at a cost

Andreessen Horowitz’s American Dynamism fund has established a new fellowship program aimed at introducing top engineers and technologists to venture investing, a move that could help the firm identify less…

a16z’s American Dynamism team launches program to introduce technical minds to VC

Another fintech startup, and its customers, has been gravely impacted by the implosion of banking-as-a-service startup Synapse. Copper Banking, a digital banking service aimed at teens, notified its customers on…

Teen fintech Copper had to abruptly discontinue its banking, debit products

Autodesk — the 3D tools behemoth — has acquired Wonder Dynamics, a startup that lets creators quickly and easily make complex characters and visual effects using AI-powered image analysis. The…

Autodesk acquires AI-powered VFX startup Wonder Dynamics

Farcaster, a blockchain-based social protocol founded by two Coinbase alumni, announced on Tuesday that it closed a $150 million fundraise. Led by Paradigm, the platform also raised money from a16z…

Farcaster, a crypto-based social network, raised $150M with just 80K daily users

Microsoft announced on Tuesday during its annual Build conference that it’s bringing “Windows Volumetric Apps” to Meta Quest headsets. The partnership will allow Microsoft to bring Windows 365 and local…

Microsoft’s new ‘Volumetric Apps’ for Quest headsets extend Windows apps into the 3D space

The spam reached Bluesky by first crossing over two other decentralized networks: Mastodon and Nostr.

The ‘vote Trump’ spam that hit Bluesky in May came from decentralized rival Nostr