This repository contains notes and code examples related to AI/ML, with a focus on understanding the fundamentals of large language models, inference engines, and hardware acceleration.
- Hailo Hailo-10H AI accelerator (NPU), Raspberry Pi AI HAT+
- Parakeet — Supporting Parakeet in whisper.cpp
- Kimi-Linear
- CUDA FA exploration
- Model Architectures
- Model Formats & Quantization
- Attention & Embeddings
- Inference & Decoding
- Training & Fine-tuning
- Hardware & Acceleration
- Audio & Speech
- Vision & Multimodal
- Agents & Applications
- Attention
- Position Embeddings
- Tokenization
- Word Embeddings
- Normalization
- Softmax / Logits / Logits
- Residual Connections
- Activation Functions
- Loss Functions
- One-Hot Encoding
- Control Vectors
- Fine-tuning
- DPO
- Reinforcement Learning
- Optimization Algorithms
- LBFGS
- Linear Regression
- Markov Chains
- Flow Matching
Exploration code for core AI/ML concepts, libraries, and frameworks.
| Project | Description |
|---|---|
| GGML | GGML C++ library exploration |
| Llama.cpp | Llama.cpp library exploration (inference, finetuning) |
| Python | Python ML examples |
| Rust | Rust ML examples (llm-chains, tch-rs, etc.) |
| vLLM | vLLM exploration |
| OpenVINO | OpenVINO Python examples |
| OpenVINO C++ | OpenVINO C++ examples |
| PyTorch | PyTorch & pybind examples |
| SIMD | SIMD instruction exploration |
| SIMD Assembly | Low-level SIMD assembly |
| SVE | ARM SVE exploration |
| NEON | ARM NEON examples |
| AMX | Intel AMX exploration |
| VNNI | VNNI instruction exploration |
| BLAS | OpenBLAS exploration |
| ROCm | AMD ROCm examples |
| SYCL | SYCL examples |
| KleidiAI | KleidiAI examples |
| Grammars | LLaGuidance grammar exploration |
| Tokenization | Tokenization examples |
| Data Structures | ML-relevant data structures |
| Image Processing | Image processing examples |
| WASM | WebAssembly NN examples |
| Whisper | Whisper.cpp exploration |
| Templates | Minja template engine |
GPU compute exploration across multiple APIs.
| Project | Description |
|---|---|
| CUDA | CUDA examples in C++ |
| OpenCL | OpenCL examples |
| Vulkan | Vulkan examples |
| Kompute | Kompute (Vulkan compute) examples |
| Metal | Metal examples |
| ROCm | AMD ROCm/HIP examples |
| WebGPU | WebGPU examples |
| XRT | XRT examples |
Neural Processing Unit exploration (Hailo).
| Project | Description |
|---|---|
| Hailo | Hailo-10H AI accelerator, Raspberry Pi AI HAT+ |
Audio processing and speech-to-text.
| Project | Description |
|---|---|
| Silero VAD | Silero Voice Activity Detection |
| Whisper.cpp | Whisper.cpp submodule |
For a complete list of all notes, see the notes directory.