Sandisk and SK hynix push High Bandwidth Flash (HBF) standard via OCP to cut AI inference costs and boost scalability.

SK hynix Inc. (or "the company",  and Sandisk Corporation held 'HBF Spec. Standardization Consortium Kick-Off' event at Sandisk Headquarters in Milpitas, California on the 25 th (local time) ...

The shift from training-focused to inference-focused economics is fundamentally restructuring cloud computing and forcing ...

“The rapid growth of LLMs has revolutionized natural language processing and AI analysis, but their increasing size and memory demands present significant challenges. A common solution is to spill ...

Upstart's 5th-gen RDU aims to undercut Nvidia's B200 on speed and cost AI infrastructure company SambaNova has raised $350 ...

An analog in-memory compute chip claims to solve the power/performance conundrum facing artificial intelligence (AI) inference applications by facilitating energy efficiency and cost reductions ...

A new technical paper titled “Hardware-based Heterogeneous Memory Management for Large Language Model Inference” was published by researchers at KAIST and Stanford University. “A large language model ...

Micron Technology is poised for explosive growth, driven by surging AI demand and its dominant position in high-bandwidth memory for leading GPUs. MU's HBM products are sold out through 2025, with ...

Microsoft’s new Maia 200 inference accelerator chip enters this overheated market with a new chip that aims to cut the price ...