article thumbnail

Getting infrastructure right for generative AI

CIO

For generative AI, a stubborn fact is that it consumes very large quantities of compute cycles, data storage, network bandwidth, electrical power, and air conditioning. But while the payback promised by many genAI projects is nebulous, the costs of the infrastructure to run them is finite, and too often, unacceptably high.

article thumbnail

5 ways to deploy your own large language model

CIO

Generative AI is transforming the world, changing the way we create images and videos, audio, text, and code. According to a September survey of IT decision makers by Dell, 76% say gen AI will have a “significant if not transformative” impact on their organizations, and most expect to see meaningful results within the next 12 months.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Generative AI in enterprises: LLM orchestration holds the key to success

CIO

Many enterprises are accelerating their artificial intelligence (AI) plans, and in particular moving quickly to stand up a full generative AI (GenAI) organization, tech stacks, projects, and governance. For readers short on time, you can skip to the section titled Strategies for effective LLM orchestration.

article thumbnail

Generative AI hallucinations: What can IT do?

CIO

Generative AI adoption is growing in the workplace—and for good reason. But the double-edged sword to these productivity gains is one of generative AI’s known Achilles heels: its ability to occasionally “ hallucinate ,” or present incorrect information as fact. Here are a range of options IT can use to get started.

article thumbnail

Should finance organizations bank on Generative AI?

CIO

As I work with financial services and banking organizations around the world, one thing is clear: AI and generative AI are hot topics of conversation. Financial organizations want to capture generative AI’s tremendous potential while mitigating its risks. In short, yes. But it’s an evolution. billion by 2032.

article thumbnail

Salesforce IT injects generative AI to ease its massive datacenter migration

CIO

That’s why SaaS giant Salesforce, in migrating its entire data center from CentOS to Red Hat Enterprise Linux, has turned to generative AI — not only to help with the migration but to drive the real-time automation of this new infrastructure. This is going to change how infrastructure is managed.”

article thumbnail

Should you build or buy generative AI?

CIO

Whether it’s text, images, video or, more likely, a combination of multiple models and services, taking advantage of generative AI is a ‘when, not if’ question for organizations. Since the release of ChatGPT last November, interest in generative AI has skyrocketed.