officialcjunior / ratchet Goto Github PK

Demo Site | Discord | Roadmap

A web-first, cross-platform ML developer toolkit

Check out our HuggingFace space for a live demo!

// Asynchronous loading & caching with IndexedDB
let model = await Model.load(AvailableModels.WHISPER_TINY, Quantization.Q8, (p: number) => setProgress(p))
let result = await model.run({ input });

Rust crate & CLI coming soon...

We want a toolkit for developers to make integrating performant AI functionality into existing production applications easy. The following principles will help us accomplish this:

1. Inference only
2. WebGPU/CPU only
3. First class quantization support
4. Lazy computation
5. Inplace by default

• Whisper
• Coming soon...