article thumbnail

From edge to cloud: The critical role of hardware in AI applications

CIO

The world has woken up to the power of generative AI and a whole ecosystem of applications and tools are quickly coming to life. All this has a tremendous impact on the digital value chain and the semiconductor hardware market that cannot be overlooked. Hardware innovations become imperative to sustain this revolution.

Hardware 221
article thumbnail

Nvidia points to the future of AI hardware

CIO

And if the Blackwell specs on paper hold up in reality, the new GPU gives Nvidia AI-focused performance that its competitors can’t match, says Alvin Nguyen, a senior analyst of enterprise architecture at Forrester Research. You can have effective basic performance, but you still have that long-term scalability issue,” he says.

Hardware 246
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Exafunction aims to reduce AI dev costs by abstracting away hardware

TechCrunch

But they share a common bottleneck: hardware. New techniques and chips designed to accelerate certain aspects of AI system development promise to (and, indeed, already have) cut hardware requirements. Emerging from stealth today, Exafunction is developing a platform to abstract away the complexity of using hardware to train AI systems.

Hardware 243
article thumbnail

EnCharge AI emerges from stealth with $21.7M to develop AI accelerator hardware

TechCrunch

EnCharge AI , a company building hardware to accelerate AI processing at the edge , today emerged from stealth with $21.7 Speaking to TechCrunch via email, co-founder and CEO Naveen Verma said that the proceeds will be put toward hardware and software development as well as supporting new customer engagements.

Hardware 216
article thumbnail

8-10x performance upticks in next-gen infrastructure enable AI workloads

CIO

Deploying AI workloads at speed and scale, however, requires software and hardware working in tandem across data centers and edge locations. Foundational IT infrastructure, such as GPU- and CPU-based processors, must provide big capacity and performance leaps to efficiently run AI. 6-8x improvement in performance.

article thumbnail

AI chip startup Axelera lands $27M in capital to commercialize its hardware

TechCrunch

Unlike conventional chips, theirs was destined for devices at the edge, particularly those running AI workloads, because Del Maffeo and the rest of the team perceived that most offline, at-the-edge computing hardware was inefficient and expensive. ai also offer in-memory solutions for AI, data analytics and machine learning applications.

Hardware 240
article thumbnail

Seeing through hardware counters: a journey to threefold performance increase

Netflix Tech

In both bands, performance characteristics remain consistent for the entire uptime of the JVM on the node, i.e. nodes never jumped the bands. Luckily, the m5.12xl instance type exposes a set of core PMCs (Performance Monitoring Counters, a.k.a. This was our starting point for troubleshooting.

Hardware 145