AiAnyTool - AI Tools Directory LogoAiAnyTool - AI Tools Directory Logo
AIAnyToolAI Tools Directory
Full ListAI CategoriesAI News Today
Loading theme toggle
Submit an AISign up
AiAnyTool - AI Tools Directory LogoAiAnyTool - AI Tools Directory Logo
AiAnyTool

Artificial intelligence for everyone. Discover, compare, and leverage over 19,000 verified AI tools.

Updated daily with manual verification

Resources

  • AI Deals & Discounts
  • AI News Today
  • Tutorials & Guides
  • MCP Servers Directory

Directory

  • Full AI List
  • AI Categories
  • Top 10 Best AI
  • New AI Tools
  • Submit an AI Tool →

About & Legal

  • About AiAnyTool
  • Contact Support
  • Privacy Policy
  • Terms of Service

© 2026 AiAnyTool.com — All rights reserved.

The definitive artificial intelligence directory and search engine.

HomeAI NewsOpen Source

Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI

Hugging FaceOpen SourceSeptember 1, 2026(Sep 1)5 min read
Share:
Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI

Full Coverage Details

Hugging Face Blog

Back to Articles a]:hidden"> Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI Published September 1, 2026 Update on GitHub Upvote 101 +95 Nico Martin nico-martin Follow Joshua Xenova Follow :last-child]:mb-0"> TL;DR Why start with kernels? A kernel repository, not just a shader Loading a kernel from the Hub How fast are the kernels? From one device to a fleet Building a shared foundation for WebAI One of our biggest goals on the WebAI team at Hugging Face is to make browser inference as fast and as user-friendly as possible. Getting there is a multi-layer effort: models need browser-friendly representations, runtimes need to build efficient execution plans, and the individual GPU operations at the bottom of the stack need to make the most of many different devices and browser implementations.

Today, we are releasing the first layer of that effort: @huggingface/kernels, a minimal library for loading and running optimized WebGPU kernels from the Hugging Face Hub, together with an initial collection of 207 kernels at huggingface.co/webgpu-kernels.

The collection covers operations used across a wide variety of machine learning architectures and workloads. More importantly, each kernel is published as a complete, versioned package: its interface, shader templates, correctness cases, benchmark cases, and usage instructions all live together on the Hub.

We are also launching Fleet, an in-browser GPU benchmarking and testing suite that runs and scores the kernels on your hardware. Beyond the results for your own machine, Fleet gives the community a way to contribute performance and correctness evidence from devices we could never cover in a conventional test lab. With your consent, every run adds private evidence that can help us find failures (incorrect results, pathologically slow cases, etc.), improve kernel variants, and make better optimization decisions across real-world hardware.

TL;DR 207 WebGPU kernels, published as individual repositories in the webgpu-kernels organization. Apache-2.0 licensed. A JavaScript loader, @huggingface/kernels, which downloads, prepares, and runs kernels directly from the Hub. Explicit contracts and reproducible evidence for every kernel, including manifests, correctness tests, benchmark cases, and WGSL shader templates. Fleet, a browser-based benchmarking tool that crowdsources correctness and performance evidence across real-world GPUs to help us improve kernels and their variants. Why start with kernels? A model running in the browser eventually becomes a sequence of GPU operations: matrix multiplications, normalizations, convolutions, attention primitives, quantization operations, data-layout transformations, and many more. WebGPU makes these operations available across modern browsers through a portable API, while WGSL provides a common language for the shaders that execute them.

Portability, however, does not automatically mean performance. Two shaders can implement the same operation and produce the same output while behaving completely differently across different accelerators. Workgroup sizes, memory access patterns, vectorization, data types, and fusion strategies can all affect performance. The best choice can also change with the input shape, device, browser, and available WebGPU features.

This is why kernels form a foundational layer of fast browser inference. Higher-level runtimes can only be as efficient as the operations they dispatch. By making those operations individually discoverable, testable, benchmarkable, and versioned, we can improve the foundation independently while keeping a stable contract for the layers above it.

A kernel repository, not just a shader Each kernel in the collection has its own repository and kernel card. The card documents the operation's semantics, inputs, outputs, attributes, supported data types, source files, and a ready-to-run @huggingface/kernels example.

For example, ai.onnx.Add implements elementwise addition with multidirectional broadcasting. It is one of the simplest operations in a neural network, used everywhere from residual connections to adding a bias. Its card documents the two inputs, the broadcasted output shape, supported data types, and the variants available for different shapes and devices.

Behind the card, the repository contains the artifacts needed to understand and evaluate the implementation:

This structure turns a shader into a reusable software artifact. The interface is inspectable without reading WGSL, correctness and performance cases travel with the implementation, and published versions can be loaded explicitly rather than depending on an unversioned file URL. Our kernels can also serve as reference implementations for developers building custom WebGPU kernels or integrating these operations into their own runtimes.

Loading a kernel from the Hub Install the package from npm:

npm install @huggingface/kernels@preview Running these kernels requires a browser with WebGPU support. WebGPU availability depends on the browser, operating system, GPU, and driver. You can check for it in JavaScript with "gpu" in navigator.

@huggingface/kernels provides the bridge between a kernel repository and your application. Call getKernel with a Hub repository ID and a contract version, then invoke the returned function with typed input data and tensor shapes. Here is a small bias-add example:

import { getKernel } from "@huggingface/kernels"; const add = await getKernel("webgpu-kernels/ai.onnx.Add", { version: 1 }); const { c } = await add({ a: { data: new Float32Array([1, 2, 3, 4, 5, 6]), shape: [2, 3], }, b: { data: new Float32Array([10, 20, 30]), shape: [3], }, }); The second input is broadcast across the first dimension, producing an output with shape [2, 3]. The loader derives that output shape and logical data type from the manifest contract and the inputs, then allocates c automatically.

H

Hugging Face

Original Reporting Source

Read Full Article at Source

AI Tools Mentioned in this Story

Explore features, ratings, and alternatives from our 19,000+ AI tools catalog.

Explore Directory

AssistLoop

Free plan with 150 message credits and basic features, Basic at $25/month for 3,000 credits and lead collection, Pro at $109/month for 15,000 credits and advanced actions, Business with custom pricing for 50,000+ credits and unlimited agents.

AssistLoop's AI chatbots slash response times by 70% and boost satisfaction, scaling support for e-commerce and SaaS without extra hires.

AlternativesView Tool

GetResponse AI Website Builder

Free + from $10.23/mo

Design professional websites effortlessly with AI.

AlternativesView Tool

HyperTxt

Lite plan at $15/month with 20 credits, Pro at $39/month (most popular) with 100 credits and priority support, Pro+ at $125/month with 500 credits and advanced features, free trial available on all paid plans.

Hypertxt.ai is an AI-powered SEO content writing tool that helps create high-quality, optimized content for improved search engine rankings. It offers various features to streamline the content creation process, from keyword research to content optimization and plagiarism checks.

AlternativesView Tool
← Back to AI News RadarExplore Trending Stories
Trending AI Stories
View All
#1

Signal blocks screenshots on iOS 27 and Android to stop AI agents from reading private chats

The Decoder • 3h ago
#2

Google's Gemini can now run Mac apps and finish desktop chores in the background while you keep working

The Decoder • 4h ago
#3

Anthropic mathematician claims to have solved prestigious Millennium Prize problem with Claude

The Verge AI • 6h ago
#4

Apple is hiring engineers to build its own AI agent

The Verge AI • 8h ago
#5

Apple joins the race for AI agents that control your device while raising new barriers for competitors

The Decoder • 8h ago

More in Open Source

DaisyRose-27B: Pushing the Frontier of Post-Training Efficiency

DaisyRose-27B: Pushing the Frontier of Post-Training Efficiency

2d ago
Why your fine-tuning job takes longer than the FLOPs say

Why your fine-tuning job takes longer than the FLOPs say

2d ago
180B Parameters, 32GB of RAM: Pushing MoE Inference to the Limit with Transformers

180B Parameters, 32GB of RAM: Pushing MoE Inference to the Limit with Transformers

2d ago
Hugging Face and OpenRouter join forces to make open-weight models easy to run

Hugging Face and OpenRouter join forces to make open-weight models easy to run

4d ago