Menu

Post image 1
Post image 2
Post image 3
Post image 4
1 / 4
0

Tenstorrent’s Galaxy Blackhole AI servers escape the event horizon

go.theregister.com·Tobias Mann·about 2 months ago
#IiIq1a4G
Reading 0:00
15s threshold

Tenstorrent on Tuesday announced the general availability of its Galaxy Blackhole AI compute platform. Each of the startup's 6U systems is packed with 32 of the Blackhole accelerators we looked at last fall . The chips are interconnected in a dense Ethernet mesh by 100 Tbps of aggregate bandwidth. Combined, Tenstorrent says each Galaxy system features 1 TB of GDDR6, 16 TB/s of memory bandwidth, and 23 petaFLOPS of dense FP8 performance, all in a system that'll set you back only $110,000. To put that in perspective, Nvidia's eight-way DGX boxes, while faster and higher capacity, will set you back somewhere between three and five times that. However, Tenstorrent's mesh network isn't limited to a single node. Much like Google's TPU or Amazon's Trainium2 clusters, it can be extended to support larger models, higher throughput, or more interactive user experiences by adding more systems and adjusting the ratio of tensor and pipeline parallelism.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More