Menu

Intel Delivers Open, Scalable AI Performance in MLPerf Inference v6.0
📰
0

Intel Delivers Open, Scalable AI Performance in MLPerf Inference v6.0

Newsroom·Daniela Morescalchi·about 1 month ago
#vXiHv4AA
Reading 0:00
15s threshold

MLPerf Inference v6.0 benchmarks showcase Intel Xeon 6 and Intel Arc Pro B-Series GPUs delivering powerful, low-latency AI inference for workstations and edge systems What’s New: Today, MLCommons released its latest MLPerf Inference v6.0 benchmarks, showcasing results across four key benchmarks for Intel’s GPU Systems. Intel’s AI systems featured Intel® Xeon® 6 CPUs and Intel® Arc™ Pro B70 graphics, demonstrating accessible AI workload solutions across high-end workstations, datacenter, and edge applications. The results show a four GPU Intel Arc Pro B70/B65 system delivers 128GB of VRAM to run 120B parameter models with high concurrency, with the Arc Pro B70 providing up to 1.8x higher inference performance than the Arc Pro B60 1 .  Software optimizations, configured in an open, containerized software stack efficiently scales inference performance from single node to multi-GPU enterprise deployments improving performance and delivering up to 1.18x higher gains on the same Intel Arc Pro B60 hardware…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More