article thumbnail

Accelerating generative AI requires the right storage

CIO

In generative AI, data is the fuel, storage is the fuel tank and compute is the engine. All this data means that organizations adopting generative AI face a potential, last-mile bottleneck, and that is storage. Novel approaches to storage are needed because generative AI’s requirements are vastly different.

article thumbnail

EnCharge AI emerges from stealth with $21.7M to develop AI accelerator hardware

TechCrunch

EnCharge AI , a company building hardware to accelerate AI processing at the edge , today emerged from stealth with $21.7 Speaking to TechCrunch via email, co-founder and CEO Naveen Verma said that the proceeds will be put toward hardware and software development as well as supporting new customer engagements.

Hardware 216
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Inferencing holds the clues to AI puzzles

CIO

As with many data-hungry workloads, the instinct is to offload LLM applications into a public cloud, whose strengths include speedy time-to-market and scalability. Inferencing funneled through RAG must be efficient, scalable, and optimized to make GenAI applications useful.

article thumbnail

The impact of AI on edge computing

CIO

IDC forecast shows that enterprise spending (which includes GenAI software, as well as related infrastructure hardware and IT/business services), is expected to more than double in 2024 and reach $151.1 Edge storage solutions: AI-generated content—such as images, videos, or sensor data—requires reliable and scalable storage.

article thumbnail

Prioritizing AI? Don’t shortchange IT fundamentals

CIO

Fundamentals like security, cost control, identity management, container sprawl, data management, and hardware refreshes remain key strategic areas for CIOs to deal with. But rapid hardware advances may mean CIOs need to budget for much shorter hardware refresh cycles in future to stay up to date.

article thumbnail

Microsoft acquires Fungible, a maker of data processing units, to bolster Azure

TechCrunch

In December, reports suggested that Microsoft had acquired Fungible, a startup fabricating a type of data center hardware known as a data processing unit (DPU), for around $190 million. ” A DPU is a dedicated piece of hardware designed to handle certain data processing tasks, including security and network routing for data traffic. .”

Azure 282
article thumbnail

What Should You Know About Graph Database’s Scalability?

Dzone - DevOps

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.