Intel-backed AI chip startup SambaNova breathes new life into aging Nvidia GPUs in latest benchmarks

Intel's big bet on SambaNova appears to be paying off in a big way. This week, the AI chip startup shared benchmark results showing its latest generation of AI acceleration, which combines Nvidia GPUs and the company's accelerators, beating GPU-only inference platforms by a wide margin. The testing, conducted by the AI benchmarking gurus at Artificial Analysis, showed SambaNova's SN50-series accelerators, announced in February, churning out 763 tokens a second in MiniMax M2.7 at short context lengths (10,000 input tokens) — several times faster than competing inference providers running on GPUs alone. Meanwhile, for longer context lengths, the company says that its platform is able to sustain more than 450 tokens a second. This feat was...

Read the full article at the source.