AI

Y Combinator-backed Poly uses AI to generate art assets

Comment

Futuristic digital blockchain background. Abstract connections technology and digital network. 3d illustration of the Big data and communications technology.
Image Credits: v_alex / Getty Images

As generative AI like ChatGPT and DALL-E 2 attract investor attention, startup entrepreneurs are looking to cash in with new business models built around them. One of the more interesting ventures to emerge from the space recently is Poly, which lets designers create video game and other virtual assets, including textures for 3D models, using only text prompts.

Poly is essentially a stock asset library along the lines of Adobe Stock and Shutterstock but populated exclusively by AI generations. While platforms like Getty Images have banned AI-generated content for fear of potential legal blowback, Poly is barreling full steam ahead.

“Almost everyone knows the all-too-common pain of searching for that perfect icon, illustration, font or sound effect online, only to give up and settle for something imperfect. Poly is trying to drastically improve this with a suite of generative tools focused on creators,” CEO Abhay Agarwal told TechCrunch in an email interview.

Before co-founding Poly with Sam Young, Agarwal was a research fellow at Microsoft, where he published papers in the field of AI for social impact. Agarwal then started Polytopal, a “human-centered AI” consulting company that worked with brands like Spotify, Meta and Nestlé to develop various intelligent systems. Among other projects, Polytopal co-created a dance choreography algorithm for the game BeatSaber and launched a virtual baking assistant for Toll House that helps design a cookie recipe to suit users’ dietary needs.

“Young and I started Poly in early 2022 from a shared passion to ‘increase the creative capacity of the world,’ and joined Y Combinator’s S22 batch,” Agarwal said.

Poly
Image Credits: Poly

Poly’s first tool in its planned web-based suite generates 3D textures with physically-based rendering maps. In modeling, “physically-based rendering” refers to a technique that aims to render images in a way that mimics the flow of light in the real world.

With Poly, designers can describe a texture (e.g. “Tree bark with moss”) and optionally provide a reference image to get generated textures for crafting 3D models. The models come in customizable resolutions and with normal and invert maps — maps often used in game development to add volume, depth and details to 3D objects’ surfaces.

“Poly trains its generative AI models with several proprietary methods, such as extracting texture information from normal images to augment its model’s learning capabilities,” Agarwal said.

When asked about how Poly treats more sensitive content that developers might request, like violent and overtly sexual generated imagery, Agarwal provided few details but said that Poly “carefully and responsibly” audits its products. “We’ve had no instances of harm reported to us yet,” he added.

Poly sees itself competing both with traditional asset marketplaces and developers’ manual design processes. Besides portals such as GameDev Market and OpenGameArt, major game engine vendors like Unity host and sell assets through their own platforms.

Poly’s also not the first to apply AI to generating game assets. Direct competitors include Hotpot and Pixela.ai, which use similar algorithms to create custom backgrounds, sprites and other art content.

Agarwal asserts that Poly’s generative AI is superior to most in terms of the quality of assets it produces. The jury’s out on that. But Poly aims to further differentiate itself by expanding its generative AI service across asset types such as illustrations, sprites, sound effects and more. It plans to make money through enterprise partnerships, premium integrations for design tools and by charging a subscription fee for royalty-free access to assets, including commercial and resale rights.

Agarwal claims that “thousands” of developers are currently using Poly’s free service, which generates an unlimited number of assets for noncommercial use, while “hundreds” are paying for Poly’s pro plan. To date, the platform has generated more than two million textures.

That momentum drew in investors, including Felicis, Bloomberg Beta, NextView Ventures, Y Combinator, Figma Ventures and the AI Grant, which together contributed $3.9 million in venture capital toward Poly at Y Combinator’s demo day in September.

“Poly’s customers range from professionals at Fortune 500 companies to individual freelancers in game design, AR/VR, interior design, architecture and 3D rendering for ecommerce and marketing,” Agarwal said. “Poly has a multi-year runway and can focus on building the best possible technology since a higher-quality product is required to stand out and win in this emerging and highly active space.”

Poly
Image Credits: Poly

Assuming Poly broadly catches on, it and its generative AI rivals run the risk of upsetting the artist community — not only because they might threaten livelihoods but because generative AI systems have been shown to regurgitate the data on which they were trained (e.g. existing art assets). On the art community portal ArtStation, which earlier this year began allowing AI-generated art on its platform for the first time, members began widely protesting by placing “No AI Art” images in their portfolios.

The alluded-to legal questions around the technology remain unresolved, as well. One class action lawsuit alleges that GitHub’s code-generating system, Copilot, regurgitates sections of licensed code without providing credit, which could have implications for art-generating AI systems as well as those that use art created by them. In an unrelated case, the U.S. Copyright Office recently ended copyright protection for a comic book created with generative AI after initially granting it, saying that only works created by humans are entitled to protection.

Agarwal isn’t concerned, though — or if he is, he isn’t showing it.

“Generative AI is facing a lot of criticism from creators and is being viewed as ‘anti-creator’ as many companies in this space want to replace creators with automated systems. However, Poly’s focus has always been to empower creators with easier access to design assets,” Agarwal said. “Building on its current momentum, Poly plans to continue its relentless focus on its proprietary generative AI innovation, model training and product development to support more types of design assets and be embedded into designers’ daily workflows.”

Poly has three employees at present, and plans to double its team in the next six-12 months.

More TechCrunch

Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.

Spotify offers Car Thing refunds as it faces lawsuit over bricking the streaming device

The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.

Misinformation works, and a handful of social ‘supersharers’ sent 80% of it in 2020

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…

Tesla shareholder sweepstakes and EV layoffs hit Lucid and Fisker

In a series of posts on X on Thursday, Paul Graham, the co-founder of startup accelerator Y Combinator, brushed off claims that OpenAI CEO Sam Altman was pressured to resign…

Paul Graham claims Sam Altman wasn’t fired from Y Combinator

In its three-year history, EthonAI has amassed some fairly high-profile customers including Siemens and chocolate-maker Lindt.

AI manufacturing startup funding is on a tear as Switzerland’s EthonAI raises $16.5M

Don’t miss out: TechCrunch Disrupt early-bird pricing ends in 48 hours! The countdown is on! With only 48 hours left, the early-bird pricing for TechCrunch Disrupt 2024 will end on…

Ticktock! 48 hours left to nab your early-bird tickets for Disrupt 2024

Biotech startup Valar Labs has built a tool that accurately predicts certain treatment outcomes, potentially saving precious time for patients.

Valar Labs debuts AI-powered cancer care prediction tool and secures $22M

Archer Aviation is partnering with ride-hailing and parking company Kakao Mobility to bring electric air taxi flights to South Korea starting in 2026, if the company can get its aircraft…

Archer, Kakao Mobility partner to bring electric air taxis to South Korea in 2026

Space startup Basalt Technologies started in a shed behind a Los Angeles dentist’s office, but things have escalated quickly: Soon it will try to “hack” a derelict satellite and install…

Basalt plans to ‘hack’ a defunct satellite to install its space-specific OS

As a teen model, Katrin Kaurov became financially independent at a young age. Aleksandra Medina, whom she met at NYU Abu Dhabi, also learned to manage money early on. The…

Former teen model co-created app Frich to help Gen Z be more realistic about finances

Can AI help you tell your story? That’s the idea behind a startup called Autobiographer, which leverages AI technology to engage users in meaningful conversations about the events in their…

Autobiographer’s app uses AI to help you tell your life story

AI-powered summaries of web pages are a feature that you will find in many AI-centric tools these days. The next step for some of these tools is to prepare detailed…

Perplexity AI’s new feature will turn your searches into shareable pages

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

A surge of battery recycling startups have emerged in Europe in a bid to tap into the next big opportunity in the EV market: battery waste.  Among them is Cylib,…

Cylib wants to own EV battery recycling in Europe

Amazon has received approval from the U.S. Federal Aviation Administration (FAA) to fly its delivery drones longer distances, the company announced on Thursday. Amazon says it can now expand its…

Amazon gets FAA approval to expand US drone deliveries

With Plannin, creators can tell their audience about their latest trip, which hotels they liked and post photos of their travels.

Former Priceline execs debut Plannin, a booking platform that uses travel influencers to help plan trips

Amazon is rolling out its AI voice search feature to Alexa, which lets it answer open-ended questions about content.

Amazon is rolling out AI voice search to Fire TV devices

Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service.

Redpanda acquires Benthos to expand its end-to-end streaming data platform

It’s a lofty goal to take on legacy payments infrastructure, however, Forward’s model has an advantage by shifting the economics back to SaaS companies.

Fintech startup Forward grabs $16M to take on Stripe, lead future of integrated payments

Fertility remains a pressing concern around the world — birthrates are down in many countries, and infertility rates (that is, the ability to conceive at all) are up. And given…

Rhea reaps $10M more led by Thiel

Microsoft, Meta, Intel, AMD and others have formed a new group to design next-gen interconnects for AI accelerator hardware.

Tech giants form an industry group to help develop next-gen AI chip components

With JioFinance, the Indian tycoon Mukesh Ambani is making his boldest consumer-facing move yet into financial services.

Ambani’s Reliance fires opening salvo in fintech battle, launches JioFinance app

Salespeople live and die by commissions. It’s no surprise, then, that Salesforce paid a premium to buy a platform that simplifies managing commissions.

Filing shows Salesforce paid $419M to buy Spiff in February

YoLa Fresh works with over a thousand retailers across Morocco and records up to $1 million in gross merchandise volume.

YoLa Fresh, a GrubMarket for Morocco, digs up $7M to connect farmers with food sellers

Instagram is expanding the scope of its “Limits” tool specifically for teenagers that would let them restrict unwanted interactions with people.

Instagram now lets teens limit interactions to their ‘Close Friends’ group to combat harassment

Agritech company Iyris helps growers across eleven countries globally increase crop yields, reduce input costs, and extend growing seasons.

Iyris makes fresh produce easier to grow in difficult climates, raises $16M

Exactly.ai says it uses generative AI to help artists retain legal ownership of their art while being able to reproduce their designs faster and at scale.

Exactly.ai secures $4M to help artists use AI to scale up their output

FintechOS competes with other companies such as Ncino, Meridian Link, Abrigo and Backbase.

Romanian startup FintechOS raises $60M to help old banks fight back against neobanks

After two years of preparation and four delays over the past several months due to technical glitches, Indian space startup Agnikul has successfully launched its first suborbital test vehicle, powered…

India’s Agnikul launches 3D-printed rocket in suborbital test after initial delays

Struggling EV startup Fisker has laid off hundreds of employees in a bid to stay alive, as it continues to search for funding, a buyout or prepare for bankruptcy. Workers…

Fisker cuts hundreds of workers in bid to keep EV startup alive