Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
1 / 7
0

I Built a Neural Network Engine in C# That Runs in Your Browser - No ONNX Runtime, No JavaScript Bridge, No Native Binaries

DEV Community: blazor·Todd Tanner·3 days ago
#YepTfkSZ
#dev#input#browser#ilgpu#model#spawndev
Reading 0:00
15s threshold

Eight months ago, the creator of ILGPU told me that supporting Blazor WebAssembly as a backend would be too difficult. Today I shipped SpawnDev.ILGPU.ML 4.0.0-preview.4 to NuGet. It runs neural networks in your browser, on your laptop, and on your server - from a single C# codebase. Six backends: WebGPU, WebGL, WebAssembly, CUDA, OpenCL, and CPU . No ONNX Runtime. No JavaScript bridge. No native binaries to install. Just C# that gets transpiled to whatever shader language the target needs. This article is about how that happened, what works today, and an honest ask for the help that would let me keep going at full speed. What works today, in your browser, right now The library ships five inference pipelines that have been validated end-to-end on every backend. Each of these images is a screenshot from the live demo at lostbeard.github.io/SpawnDev.ILGPU.ML - the model output rendered directly from a GPU buffer to an HTML <canvas> via the library's ICanvasRenderer .…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More