What is inference? Explaining the massive new shift in AI computing

The focus of artificial-intelligence spending has gone from training models to using them. Here’s how to understand the ...
Electronics Weekly

Camera reference design delivers 4K AI inference

The 4Kp30 multi-sensor camera reference design is by Altera and designed for its Agilex 5 FPGAs. It uses industry-standard MIPI connectivity: D-PHY and MIPI CSI-2 for the FPGA interface and Altera’s ...
VentureBeat

AI inference acceleration on CPUs

The vast proliferation and adoption of AI over the past decade has started to drive a shift in AI compute demand from training to inference. There is an increased push to put to use the large number ...
EDN

Purpose-built AI inference architecture: Reengineering compute design

Over the past several years, the lion’s share of artificial intelligence (AI) investment has poured into training infrastructure—massive clusters designed to crunch through oceans of data, where speed ...
VentureBeat

AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation

Lowering the cost of inference is typically a combination of hardware and software. A new analysis released Thursday by Nvidia details how four leading inference providers are reporting 4x to 10x ...