Enterprise

Amazon CTO Werner Vogels on culturally aware LLMs, developer productivity and FemTech

Comment

Image Credits: Johannes Simon/Getty Images / Getty Images

By tradition, Amazon CTO Werner Vogels caps off the AWS re:Invent conference with his last-day keynote. A more recent tradition is that he also uses that day to publish his predictions for the coming year. This time around, I sat down with Vogels for a wide-ranging interview ahead of his keynote to delve a little bit deeper into the trends he is seeing and expects to accelerate in the coming year.

This being 2023, a lot of our discussion focused on generative AI, of course. But the Netherlands-born and -based Vogels does have an interesting perspective here — and one that is still often lacking in many discussions around generative AI. His first prediction is that generative AI will become culturally aware, meaning that models will gain a better understanding of different cultural traditions.

https://techcrunch.com/2023/11/29/heres-everything-aws-reinvent-2023-so-far/

“You start to realize that most of these machines have been trained on Common Crawl, which is English, very U.S.-centric and Western European,” he said. “And it’s not just a matter of language — although language often incorporates cultural kinds of things — but it is much more the data that they’ve been trained on.”

He noted that if companies want to deploy these genAI tools across the world, they have to start thinking about how to make their models more culturally aware. “If we don’t solve it, it will be a massive hindrance for deploying this technology worldwide because it’s not just about language, it’s about all the cultural aspects which are meaningful to us as humans,” he said.

He noted that he believes that there are technologies available today that can solve this, including having multiple agents debating and testing each other, for example.

Being at a developer event, we also touched upon what this new world of large language models (LLMs) means for developers. Vogels, like many in our industry, believes that generative AI will greatly enhance developer productivity. The tools that were available a couple of years ago, he noted, were useful for a certain kind of developer, but today’s code completion and generation services take on a very different quality.

aws logo
AWS logo. Image Credits: TechCrunch

“I think the tools at that moment were at the level that really supported the sort of ‘copy-and-paste’ developer, the person that would normally go to Stack Overflow, post the question, wait for a hundred upvotes and think: that must be the right answer,” Vogels said.

That work back then, he believes, was mostly focused on efficiency. “I think what has changed is that the tools now can have a broader view of things,” he said. He likened this new generation of development tools to pair programming, where the AI model is more like having a very senior developer by your side who knows everything about a given code base.

Like many of his peers, Vogels also strongly believes that generative AI will free developers from a lot of the busywork of writing tests, refactoring code and writing boilerplate. And while some technologists are worried that using these tools will actually hinder junior developers from honing their craft, Vogels doesn’t believe that’s the case. “There’s a ton of learning on the job. That has always been happening. I expect with the newer tools, that this education will go faster, but there’s always a lot of education on the job.”

He also noted that the ever-increasing pace of technological development means that it’s now more important than ever for colleges and universities not just to teach students raw skills but how to learn. “There is extreme value in what universities teach you: they teach you how to learn. They teach you how to look at the bigger picture. They teach you how to analyze. They teach all these brain things that you will need on the job,” Vogels said — though he didn’t want to get into a discussion about the current plight of humanities programs in the United States.

Vogel’s predictions don’t only focus on AI, though. He also believes that women’s health tech will finally take off, in part because there is less of a stigma now around talking about women’s healthcare. “It’s a societal change. The stigma is changing. Men are talking about menopause these days, because their wives or friends or girlfriends or daughters are going through it and they see it. If you go back 20 years, women among themselves wouldn’t even talk about it,” he said. And with that, venture capital is also starting to flow into this market.

Despite 2022’s headwinds, women’s health startups did better than ever before

Vogels believes that since the medical establishment often dismissed women’s health concerns or privileges men’s health, we may arrive at an interesting moment now with the advent of personalized and precision medicine where a lot of women’s healthcare will leapfrog right to these more modern techniques.

“I see this in femtech, where the shift immediately is: let’s take this one step further — let’s make sure that we can actually do precision healthcare,” he said.

In many ways, Vogels is an optimist when it comes to tech and its potential to do good. “I’ve solved so many problems in my life. Am I an optimist? Yes, I do think so — because we want to make this work,” he said. He also added that while the U.S. startup scene may be consumed with the idea of creating unicorns, in the rest of the world, people often just want to build a sustainable business.

But he did note that one issue the technology industry faces is that it moves at such a rapid clip right now, it’s hard for people to catch up. “The challenge we have, I think, today, is that our technology adoption cycles have become so compressed that it’s hard to educate people upfront — before technology gets released. I think it’s one of the challenges. Maybe not even for businesses, but if you release consumer technology out in the open without any education, people are going to get confused. You get a knee-jerk reaction. I think with goodwill, we will fix these things. But we also need to make sure we don’t underestimate that we need to continue to educate people about new technologies that we’re delivering.”

There is one thing that makes him happy about this quick cycle, though. “The good thing is: I don’t need to talk to my customers about blockchain anymore,” he said with a grin.

Read more about AWS re:Invent 2023 on TechCrunch

More TechCrunch

AI models are always surprising us, not just in what they can do, but what they can’t, and why. An interesting new behavior is both superficial and revealing about these…

AI models have favorite numbers, because they think they’re people

On Friday, Pal Kovacs was listening to the long-awaited new album from rock and metal giants Bring Me The Horizon when he noticed a strange sound at the end of…

Rock band’s hidden hacking-themed website gets hacked

Jan Leike, a leading AI researcher who earlier this month resigned from OpenAI before publicly criticizing the company’s approach to AI safety, has joined OpenAI rival Anthropic to lead a…

Anthropic hires former OpenAI safety lead to head up new team

Welcome to TechCrunch Fintech! This week, we’re looking at the long-term implications of Synapse’s bankruptcy on the fintech sector, Majority’s impressive ARR milestone, and more!  To get a roundup of…

The demise of BaaS fintech Synapse could derail the funding prospects for other startups in the space

YouTube’s free Playables don’t directly challenge the app store model or break Apple’s rules. However, they do compete with the App Store’s free games.

YouTube’s free games catalog ‘Playables’ rolls out to all users

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

4 hours ago
A comprehensive list of 2024 tech layoffs

OpenAI has formed a new committee to oversee “critical” safety and security decisions related to the company’s projects and operations. But, in a move that’s sure to raise the ire…

OpenAI’s new safety committee is made up of all insiders

Time is running out for tech enthusiasts and entrepreneurs to secure their early-bird tickets for TechCrunch Disrupt 2024! With only four days left until the May 31 deadline, now is…

Early bird gets the savings — 4 days left for Disrupt sale

AI may not be up to the task of replacing Google Search just yet, but it can be useful in more specific contexts — including handling the drudgery that comes…

Skej’s AI meeting scheduling assistant works like adding an EA to your email

Faircado has built a browser extension that suggests pre-owned alternatives for ecommerce listings.

Faircado raises $3M to nudge people to buy pre-owned goods

Tumblr, the blogging site acquired twice, is launching its “Communities” feature in open beta, the Tumblr Labs division has announced. The feature offers a dedicated space for users to connect…

Tumblr launches its semi-private Communities in open beta

Remittances from workers in the U.S. to their families and friends in Latin America amounted to $155 billion in 2023. With such a huge opportunity, banks, money transfer companies, retailers,…

Félix Pago raises $15.5 million to help Latino workers send money home via WhatsApp

Google said today it’s adding new AI-powered features such as a writing assistant and a wallpaper creator and providing easy access to Gemini chatbot to its Chromebook Plus line of…

Google adds AI-powered features to Chromebook

The dynamic duo behind the Grammy Award–winning music group the Chainsmokers, Alex Pall and Drew Taggart, are set to bring their entrepreneurial expertise to TechCrunch Disrupt 2024. Known for their…

The Chainsmokers light up Disrupt 2024

The deal will give LumApps a big nest egg to make acquisitions and scale its business.

LumApps, the French ‘intranet super app,’ sells majority stake to Bridgepoint in a $650M deal

Featured Article

More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Nubank is taking its first tentative steps into the mobile network realm, as the NYSE-traded Brazilian neobank rolls out an eSIM (embedded SIM) service for travelers. The service will give customers access to 10GB of free roaming internet in more than 40 countries without having to switch out their own existing physical SIM card or…

11 hours ago
More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Infra.Market, an Indian startup that helps construction and real estate firms procure materials, has raised $50M from MARS Unicorn Fund.

MARS doubles down on India’s Infra.Market with new $50M investment

Small operations can lose customers by not offering financing, something the Berlin-based startup wants to change.

Cloover wants to speed solar adoption by helping installers finance new sales

India’s Adani Group is in discussions to venture into digital payments and e-commerce, according to a report.

Adani looks to battle Reliance, Walmart in India’s e-commerce, payments race, report says

Ledger, a French startup mostly known for its secure crypto hardware wallets, has started shipping new wallets nearly 18 months after announcing the latest Ledger Stax devices. The updated wallet…

Ledger starts shipping its high-end hardware crypto wallet

A data protection taskforce that’s spent over a year considering how the European Union’s data protection rulebook applies to OpenAI’s viral chatbot, ChatGPT, reported preliminary conclusions Friday. The top-line takeaway…

EU’s ChatGPT taskforce offers first look at detangling the AI chatbot’s privacy compliance

Here’s a shoutout to LatAm early-stage startup founders! We want YOU to apply for the Startup Battlefield 200 at TechCrunch Disrupt 2024. But you’d better hurry — time is running…

LatAm startups: Apply to Startup Battlefield 200

The countdown to early-bird savings for TechCrunch Disrupt, taking place October 28–30 in San Francisco, continues. You have just five days left to save up to $800 on the price…

5 days left to get your early-bird Disrupt passes

Venture investment into Spanish startups also held up quite well, with €2.2 billion raised across some 850 funding rounds.

Spanish startups reached €100 billion in aggregate value last year

Featured Article

Onyx Motorbikes was in trouble — and then its 37-year-old owner died

James Khatiblou, the owner and CEO of Onyx Motorbikes, was watching his e-bike startup fall apart.  Onyx was being evicted from its warehouse in El Segundo, near Los Angeles. The company’s unpaid bills were stacking up. Its chief operating officer had abruptly resigned. A shipment of around 100 CTY2 dirt bikes from Chinese supplier Suzhou…

1 day ago
Onyx Motorbikes was in trouble — and then its 37-year-old owner died

Featured Article

Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Iyo represents a third form factor in the push to deliver standalone generative AI devices: Bluetooth earbuds.

1 day ago
Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Arati Prabhakar, profiled as part of TechCrunch’s Women in AI series, is director of the White House Office of Science and Technology Policy.

Women in AI: Arati Prabhakar thinks it’s crucial to get AI ‘right’

AniML, the French startup behind a new 3D capture app called Doly, wants to create the PhotoRoom of product videos, sort of. If you’re selling sneakers on an online marketplace…

Doly lets you generate 3D product videos from your iPhone

Elon Musk’s AI startup, xAI, has raised $6 billion in a new funding round, it said today, as Musk shores up capital to aggressively compete with rivals including OpenAI, Microsoft,…

Elon Musk’s xAI raises $6B from Valor, a16z, and Sequoia

Indian startup Zypp Electric plans to use fresh investment from Japanese oil and energy conglomerate ENEOS to take its EV rental service into Southeast Asia early next year, TechCrunch has…

Indian EV startup Zypp Electric secures backing to fund expansion to Southeast Asia