⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
rust machine-learning transformers api-server developer-tools llama command-line-tool inference-server webgpu rust-crate huggingface huggingface-transformers huggingface-models webgpu-shaders llamacpp llm-inference local-ai gguf ollama-api openai-compatible
-
Updated
Aug 2, 2026 - Rust
