AI

Y Combinator-backed Poly uses AI to generate art assets

Comment

Futuristic digital blockchain background. Abstract connections technology and digital network. 3d illustration of the Big data and communications technology.
Image Credits: v_alex / Getty Images

As generative AI like ChatGPT and DALL-E 2 attract investor attention, startup entrepreneurs are looking to cash in with new business models built around them. One of the more interesting ventures to emerge from the space recently is Poly, which lets designers create video game and other virtual assets, including textures for 3D models, using only text prompts.

Poly is essentially a stock asset library along the lines of Adobe Stock and Shutterstock but populated exclusively by AI generations. While platforms like Getty Images have banned AI-generated content for fear of potential legal blowback, Poly is barreling full steam ahead.

“Almost everyone knows the all-too-common pain of searching for that perfect icon, illustration, font or sound effect online, only to give up and settle for something imperfect. Poly is trying to drastically improve this with a suite of generative tools focused on creators,” CEO Abhay Agarwal told TechCrunch in an email interview.

Before co-founding Poly with Sam Young, Agarwal was a research fellow at Microsoft, where he published papers in the field of AI for social impact. Agarwal then started Polytopal, a “human-centered AI” consulting company that worked with brands like Spotify, Meta and Nestlé to develop various intelligent systems. Among other projects, Polytopal co-created a dance choreography algorithm for the game BeatSaber and launched a virtual baking assistant for Toll House that helps design a cookie recipe to suit users’ dietary needs.

“Young and I started Poly in early 2022 from a shared passion to ‘increase the creative capacity of the world,’ and joined Y Combinator’s S22 batch,” Agarwal said.

Poly
Image Credits: Poly

Poly’s first tool in its planned web-based suite generates 3D textures with physically-based rendering maps. In modeling, “physically-based rendering” refers to a technique that aims to render images in a way that mimics the flow of light in the real world.

With Poly, designers can describe a texture (e.g. “Tree bark with moss”) and optionally provide a reference image to get generated textures for crafting 3D models. The models come in customizable resolutions and with normal and invert maps — maps often used in game development to add volume, depth and details to 3D objects’ surfaces.

“Poly trains its generative AI models with several proprietary methods, such as extracting texture information from normal images to augment its model’s learning capabilities,” Agarwal said.

When asked about how Poly treats more sensitive content that developers might request, like violent and overtly sexual generated imagery, Agarwal provided few details but said that Poly “carefully and responsibly” audits its products. “We’ve had no instances of harm reported to us yet,” he added.

Poly sees itself competing both with traditional asset marketplaces and developers’ manual design processes. Besides portals such as GameDev Market and OpenGameArt, major game engine vendors like Unity host and sell assets through their own platforms.

Poly’s also not the first to apply AI to generating game assets. Direct competitors include Hotpot and Pixela.ai, which use similar algorithms to create custom backgrounds, sprites and other art content.

Agarwal asserts that Poly’s generative AI is superior to most in terms of the quality of assets it produces. The jury’s out on that. But Poly aims to further differentiate itself by expanding its generative AI service across asset types such as illustrations, sprites, sound effects and more. It plans to make money through enterprise partnerships, premium integrations for design tools and by charging a subscription fee for royalty-free access to assets, including commercial and resale rights.

Agarwal claims that “thousands” of developers are currently using Poly’s free service, which generates an unlimited number of assets for noncommercial use, while “hundreds” are paying for Poly’s pro plan. To date, the platform has generated more than two million textures.

That momentum drew in investors, including Felicis, Bloomberg Beta, NextView Ventures, Y Combinator, Figma Ventures and the AI Grant, which together contributed $3.9 million in venture capital toward Poly at Y Combinator’s demo day in September.

“Poly’s customers range from professionals at Fortune 500 companies to individual freelancers in game design, AR/VR, interior design, architecture and 3D rendering for ecommerce and marketing,” Agarwal said. “Poly has a multi-year runway and can focus on building the best possible technology since a higher-quality product is required to stand out and win in this emerging and highly active space.”

Poly
Image Credits: Poly

Assuming Poly broadly catches on, it and its generative AI rivals run the risk of upsetting the artist community — not only because they might threaten livelihoods but because generative AI systems have been shown to regurgitate the data on which they were trained (e.g. existing art assets). On the art community portal ArtStation, which earlier this year began allowing AI-generated art on its platform for the first time, members began widely protesting by placing “No AI Art” images in their portfolios.

The alluded-to legal questions around the technology remain unresolved, as well. One class action lawsuit alleges that GitHub’s code-generating system, Copilot, regurgitates sections of licensed code without providing credit, which could have implications for art-generating AI systems as well as those that use art created by them. In an unrelated case, the U.S. Copyright Office recently ended copyright protection for a comic book created with generative AI after initially granting it, saying that only works created by humans are entitled to protection.

Agarwal isn’t concerned, though — or if he is, he isn’t showing it.

“Generative AI is facing a lot of criticism from creators and is being viewed as ‘anti-creator’ as many companies in this space want to replace creators with automated systems. However, Poly’s focus has always been to empower creators with easier access to design assets,” Agarwal said. “Building on its current momentum, Poly plans to continue its relentless focus on its proprietary generative AI innovation, model training and product development to support more types of design assets and be embedded into designers’ daily workflows.”

Poly has three employees at present, and plans to double its team in the next six-12 months.

More TechCrunch

With the release of iOS 18 later this year, Apple may again borrow ideas third-party apps. This time it’s Arc that could be among those affected.

Is Apple planning to ‘sherlock’ Arc?

TechCrunch Disrupt 2024 will be in San Francisco on October 28–30, and we’re already excited! This is the startup world’s main event, and it’s where you’ll find the knowledge, tools…

Meet Visa, Mercury, Artisan, Golub Capital and more at TC Disrupt 2024

Featured Article

The women in AI making a difference

As a part of a multi-part series, TechCrunch is highlighting women innovators — from academics to policymakers —in the field of AI.

2 hours ago
The women in AI making a difference

U.S. Rep. Elissa Slotkin will introduce a bill to Congress that would limit or ban the introduction of connected vehicles built by Chinese companies if found to pose a threat…

Chinese EVs – and their connected tech – are the next target of US lawmakers

Ifeel is being offered as part of an employer’s or insurance provider’s healthcare coverage.

Mental health insurance platform ifeel  raises a $20 million Series B

Instead of opening the user’s actual browser or a WebView, Custom Tabs let users remain in their app while browsing.

Google Chrome becomes a ‘picture-in-picture’ app

Sanil Chawla remembers the meetings he had with countless artists in college. Those creatives were looking for one thing: sustainable economic infrastructure that could help them scale rather than drown…

Creator fintech Slingshot raises $2.2M

A startup called Firefly that’s tackling the thorny and growing issue of cloud asset management with an “infrastructure as code” solution has raised $23 million in funding. That comes on…

Firefly forges on after co-founder murdered by Hamas

Mistral, the French AI startup backed by Microsoft and valued at $6 billion, has released its first generative AI model for coding, dubbed Codestral. Like other code-generating models, Codestral is…

Mistral releases Codestral, its first generative AI model for code

Pinterest announced today that it is evolving its Creator Inclusion Fund to now be called the Pinterest Inclusion Fund. Pinterest teamed up with Shopify’s Build Black and Build Native programs…

Pinterest expands its Creator Fund to allow founders

Cadillac may seem a bit too traditional to hang its driving cap on EVs. And yet, that hasn’t stopped the GM brand from rolling out — or at least showing…

Cadillac’s new Optiq EV is designed to hook young hipsters

Alex Taub, a longtime founder with multiple exits under his belt, believes it’s time to disrupt the meme industry. “I have this big thesis that meme tech is going to…

This founder says meme tech is the next big thing

Lux, the startup behind popular pro photography app Halide and others, is venturing into video with its latest app launch. On Wednesday, the company announced Kino, a new video capture app…

Kino is a new iPhone app for videographers from the makers of Halide

DevOps startup Harness has shown itself to be an ambitious company, building a broad platform of services while also dabbling in M&A when it made sense to fill in functionality.…

Harness snags Split.io as it goes all in on feature flags and experiments

Microsoft’s Copilot, a generative AI-powered tool that can generate text as well as answer specific questions, is now available as an in-app chatbot on Telegram, the instant messaging app.  Currently…

Microsoft’s Copilot is now on Telegram

HBO’s new documentary, “MoviePass, MovieCrash,” tells a story that many of us know about: how MoviePass, the subscription-based movie ticketing startup, was a catastrophic failure. After a series of mishaps…

MoviePass co-founders speak their truth in HBO’s new documentary 

The watch features a variety of different 3D games, unlocking more play time the more kids move.

Fitbit’s new kid smartwatch is a little Wiimote, a little Tamagotchi

In the video, a crowd is roaring at a packed summer music festival. As a beat starts playing over the speakers, the performer finally walks onstage: It’s the Joker. Clad…

Discord has become an unlikely center for the generative AI boom

After the Wirecard scandal, Germany’s financial regulator BaFin started to look more closely at young fintech startups that wanted to grow at a rapid pace — it’s better to be…

Germany’s financial regulator ends anti-money laundering cap on N26 signups after $10M fine

Among other things, this includes the ability to trace code from source to binary packages across both platforms, single sign-on support and unified project structures.

JFrog and GitHub team up to closely integrate their source code and binary platforms

The company’s public fund disbursement and e-commerce platform makes accepting school tuition and enabling educational enrichment more accessible. 

Tech startup Odyssey goes on journey to help states implement school choice programs

A new startup called Kinnect aims to help people privately save generational memories, traditions, recipes and more. The company’s app, launched this month, lets people create invite-only spaces where they…

Kinnect’s new app aims to help families record and store generational memories

Spotify has hiked its premium subscription in France by an eye-watering €0.13, in response to a new music-streaming tax.

Spotify hikes subscription price in France by 1.2% to match new music-streaming tax

The European Union has taken the wraps off the structure of the new AI Office, the ecosystem-building and oversight body that’s being established under the bloc’s AI Act. The risk-based…

With the EU AI Act incoming this summer, the bloc lays out its plan for AI governance

Solutions by Text, a company that gives people a way to pay their bills and apply for loans via text messaging, has secured $110 million in new growth funding. Edison…

Bootstrapped for over a decade, this Dallas company just secured $110M to help people pay bills by text

Owners of small- and medium-sized businesses check their bank balances daily to make financial decisions. But it’s entrepreneur Yoseph West’s assertion that there’s typically information and functions missing from bank…

Relay raises $32.2 million to help smaller businesses manage their cash flow

When other firms were investing and raising eye-popping sums, Clean Energy Ventures took a different approach. It appears to be paying off.

How Clean Energy Ventures avoided the pandemic bubble and raised a $305M fund

PwC, the management consulting giant, will become OpenAI’s biggest customer to date, covering 100,000 users.

OpenAI signs 100K PwC workers to ChatGPT’s enterprise tier as PwC becomes its first resale partner

Tech enthusiasts and entrepreneurs, the clock is ticking! With just 72 hours remaining until the early-bird ticket deadline for TechCrunch Disrupt 2024, now is the time to secure your spot…

72 hours left of the Disrupt early-bird sale

Avendus, the top investment bank for venture deals in India, confirmed on Wednesday it is looking to raise up to $350 million for its new private equity fund.  The new…

Avendus, India’s top venture adviser, confirms it’s looking to raise a $350M fund