Skip to content
#

inference-server

Star

Here are 2 public repositories matching this topic...

Language: JavaScript
Filter by language
All 133 Python 72 C++ 11 Rust 11 Go 7 Jupyter Notebook 6 TypeScript 5 Swift 4 JavaScript 2 Shell 2 HTML 1

TommyLemon / CVAuto

Star 41

👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等，直接零代码���速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法：行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割 等，还可一键 下载测试报告、导出训练和测试数据集

ocr ai computer-vision detection cv test-automation yolo classification segmentation face-recognition rotation cv2 inference-server pose-estimation apijson inference-api ultralytics ai-testing yolo11 ultralytics-yolo
  • Updated Jun 15, 2026
  • JavaScript

boringresearchjames / llamafleet

Star 2

llama.cpp fleet manager with orchestration routing — cut AI coding tool costs by routing tool-loop turns to local GPU models and frontier APIs (Copilot, OpenRouter). GPU pinning, heterogeneous pools, browser dashboard, OpenAI-compatible API.

self-hosted nvidia gpu-acceleration multi-model inference-server homelab multi-gpu rocm load-balancing llm llama-cpp llm-inference local-ai gguf ai-gateway llama-server llm-orchestration openai-compatible gpu-pinning llamafleet
  • Updated Jul 15, 2026
  • JavaScript

Improve this page

Add a description, image, and links to the inference-server topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the inference-server topic, visit your repo's landing page and select "manage topics."

Learn more