All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

🦖 Serverless AI Agent Framework with Geo-distributed Edge AI Infra.

258 KB WASM runtime for Needle a 26M-parameter tool-calling transformer. Runs in browser, Cloudflare Workers, and Node.js. No backend required.

Pydantic + Instructor for Rust: extract structured, validated data from LLMs (OpenAI GPT, Anthropic Claude, Gemini, Grok/xAI) into native Rust structs & enums. Derive macros auto-generate JSON Schema, parse responses, and retry on validation errors. Type-safe structured outputs & function calling.

A lightweight, portable executable for invoking LLM with multi-API support - eliminating installation requirements while maintaining operational efficiency. 轻量级大语言模型api调用工具，无需安装，仅一个~10M可执行文件，支持自定义多种模型（OpenAI、Claude、Gemini、DeepSeek等，以及第三方提供的api）和prompt。

Serialize your functions with tools-rs!

Ultra-low-latency reverse proxy that repairs truncated & malformed JSON in LLM streaming responses (OpenAI, Anthropic, Vertex AI, Bedrock) — fixes JSONDecodeError / serde_json EOF on truncated tool calls.

Full Rust SDK for the Gemini Multimodal Live API — wire protocol, agent runtime, and fluent DX in three layered crates.

The tool surface every agentic AI framework reimplements.

firebat

Desktop AI assistant overlay with DeepSeek-optimized reasoning, long-term memory, skill/equipment self-evolution, Chrome CDP browser automation, and task tracking. Built in Rust with wry WebView.

A modern, async-first Rust framework for building LLM-compatible tools with zero-cost abstractions and compile-time registration.

Fork of xai-org/grok-build (grok CLI coding agent) that fixes tool calls crashing on stringified numeric arguments from Qwen qwen3_xml / non-type-coercing tool formats. Includes prebuilt grok 0.2.111.