local-llms

Multi-tenant fine-tuning for LLMs with Tinker-compatible API

Fast-ASDLC: 5x TTM with AI-native Agentic SDLC. Local-LLM first, Human-in-the-loop, Spec-driven. Built on DDD, Hexagonal Architecture, C4 Model & MCP. Features Meta-agents for self-improvement, Memory Bank for context persistence, and automated 100% test coverage. Everything-as-Code & Mermaid.js centric to save context window and slash token costs.

CROW - Your AI Agent. MCPs, OpenRouter, Any Model or local. It's your choice.

A from-scratch implementation of the language-model training pipeline in PyTorch: tokenization, pretraining, SFT, and preference-based alignment.

Describe images with Ollama

🚀 Unified NLP Pipelines for Language Models

Delta: LLM conversation branching

J.A.R.V.I.S: An AI-powered Open Source Intelligence (OSINT) system. It orchestrates deep web scraping and local LLMs to autonomously generate comprehensive intelligence dossiers.

A Unity package for building open-source AI voice agents that run fully locally. You can use it to build intelligent non-player characters (NPCs), game interfaces, among many other applications.

Playground for learning by doing

Nova Studio - Windows desktop workbench for local LLM inference (vLLM / SGLang / llama.cpp via WSL2), bridging WSL engines to any OpenAI-compatible client

Turbo Ultimate Field Fare is a MacOS app that lets users run models like Qwen, Gemma, and GPT-OSS models with expert-streaming, allowing for large models on devices without a lot of memory.

XR — the secure, self-hosted AI agent. BYOK · local-first · spend-capped · tamper-evident. by rrrtx

The Operating System for Local Intelligence. ⚙️

A lightweight CLI to orchestrate Gemini and GPT using your local files as a shared blackboard.

Model-agnostic autonomous coding agent engine with Claude Code capabilities, subagents, and an 18-target cross-agent SSOT harness

Local-first RAG endpoint that answers cheap questions locally and escalates hard ones to the cloud automatically, behind your LLM Proxy

🤖 Autonomous AI career engine — scans 28,700+ real tech company ATS boards (Greenhouse, Lever, Ashby, Workday & SmartRecruiters), monitors Wellfound alerts + custom career pages, scores via cosine similarity + LLM rubrics, generates STAR-tailored pitches for 1-click review. 100% Free.

Local-first RAG pipeline — ChromaDB, DeepSeek-R1 via Ollama, idempotent ingestion, reactive Marimo UI. Zero cloud APIs. Fully Dockerized.

RAG Intelligent Question-Answering System Based on LangChain