← OSS.Radar home

Powered by aegismemory.com · Aegis Memory repository

Local And Edge Ai AI repositories

OSS Radar projects in the local and edge ai category.

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Category
local and edge ai
Stars
178,022
Readiness
ready (94/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
0/100 · high confidence

Why: +580 stars in 7 days; 85 commits in 30 days

Why it may be a gem: consistent human and community activity; healthy maintenance and project fundamentals

Strongest signals: push recency, commit activity, contributor breadth. Risks: None identified. Missing inputs: None.

Capped lower bounds: lifetime contributors, response activity.

deepseek gemma gemma3 glm go golang

AlexsJones/llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

Category
local and edge ai
Stars
31,239
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
0/100 · high confidence

Why: +231 stars in 7 days; 100+ commits in 30 days

Why it may be a gem: healthy maintenance and project fundamentals; consistent human and community activity

Strongest signals: push recency, commit activity, contributor breadth. Risks: None identified. Missing inputs: None.

Capped lower bounds: 30-day commits, response activity.

gguf llm localai mlx skill unsloth

Open-LLM-VTuber/Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

Category
local and edge ai
Stars
13,141
Readiness
needs review (47/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +139 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-companion ai-vtuber ai-waifu chatbots live2d

TheR1D/shell_gpt

A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

Category
local and edge ai
Stars
12,233
Readiness
needs review (68/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +21 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatgpt cheat-sheet cli commands gpt-3 gpt-4

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Category
local and edge ai
Stars
10,943
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 836 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt code-llama codellama gpt gpt-4

intel/ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete

Category
local and edge ai
Stars
8,863
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 191 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gpu llm pytorch transformers

agents-io/PokeClaw

PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.

Category
local and edge ai
Stars
999
Readiness
needs review (56/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

accessibility ai-agent android-automation gemma4 litert local-llm

satellitecomponent/Neurite

Fractal Graph-of-Thought. Rhizomatic Mind-Mapping for Ai-Agents, Web-Links, Notes, and Code.

Category
local and edge ai
Stars
2,113
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
24/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 144 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents ai-agents-framework ai-graphs ai-os fractals graph-of-thoughts

langbot-app/LangBot

Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integr

Category
local and edge ai
Stars
17,325
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +125 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent coze deepseek dify dingtalk discord

MODSetter/SurfSense

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://dis

Category
local and edge ai
Stars
15,800
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +139 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents ai fastapi langchain langgraph

cactus-compute/cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

Category
local and edge ai
Stars
5,565
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +13 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android arm edge edge-ai framework

PySpur-Dev/pyspur

A visual playground for agentic workflows: Iterate over your agents 10x faster

Category
local and edge ai
Stars
5,769
Readiness
needs review (66/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents ai builder deepseek framework

rag-web-ui/rag-web-ui

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

Category
local and edge ai
Stars
3,250
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
21/100 · low confidence

Why: +166 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 123 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai deepseek langchain ollama rag

datawhalechina/handy-ollama

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

Category
local and edge ai
Stars
2,492
Readiness
needs review (47/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent gguf langchain large-language-models llamaindex llm

undreamai/LLMUnity

Create characters in Unity with LLMs!

Category
local and edge ai
Stars
1,692
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
17/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 100 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai character chat chatbot conversational-ai dialogue

pipeshub-ai/pipeshub-ai

PipesHub is an open-source fully extensible AI context layer that unifies your business data for explainable enterprise search and agentic workflow automation.

Category
local and edge ai
Stars
3,166
Readiness
ready (94/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +25 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents ai drive glean gmail

siddsachar/row-bot

Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge graph, voice, vision, shell, browser automation, scheduled tasks, health tracking, and messagi

Category
local and edge ai
Stars
1,420
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +23 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant langchain langchain-python local-llm ollama privacy

benman1/generative_ai_with_langchain

Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.

Category
local and edge ai
Stars
1,400
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent chatgpt claude claude-3-5-sonnet deepseek deepseek-r1

andrewnguonly/Lumos

A RAG LLM co-pilot for browsing the web, powered by local LLMs

Category
local and edge ai
Stars
1,516
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 558 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chrome-extension langchain langchain-js llm ollama react

goruck/home-generative-agent

AI agent for Home Assistant — talk to your home, create automations in plain English, analyze cameras with face recognition, and get proactive anomaly alerts. Cloud LLMs or fully local via Ollama.

Category
local and edge ai
Stars
281
Readiness
ready (96/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent anomaly-detection anthropic computer-vision gemini generative-ai

Vasallo94/ObsidianRAG

Ask questions about your Obsidian notes using local AI. Privacy-first RAG with Ollama, LM Studio, or any OpenAI-compatible server. Obsidian plugin + Docker + PyPI.

Category
local and edge ai
Stars
115
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chromadb docker fastapi langchain langgraph

harishdeivanayagam/rowfill

Open-source spreadsheets platform for deep research and document processing

Category
local and edge ai
Stars
368
Readiness
high risk (44/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 316 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

document document-extraction document-parsing image-ocr langgraph llama

LangGraph-GUI/LangGraph-GUI

Visual node-edge graph GUI editor for LangGraph and run with local LLM or online API

Category
local and edge ai
Stars
265
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 195 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

docker docker-compose k8s kubernetes langgraph langgraph-gui

Oqura-ai/deepdoc

Deep research tool for local knowledge base.

Category
local and edge ai
Stars
257
Readiness
needs review (56/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
16/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 95 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai deepresearch langchain langgraph llms ollama

Ganador1/FenixAI_tradingBot

Fenix Ai Trading Bot with LangGraph and ollama and multipe providers

Category
local and edge ai
Stars
146
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai autonomous-agents crewai ganador llm localllm

kossakovsky/selfhost-ai

🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one command. Auto HTTPS. Free Zapier/Make alternative.

Category
local and edge ai
Stars
913
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-agents automation chatgpt-alternative dify docker

Mcourtyard/m-courtyard

M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + React + mlx-lm.

Category
local and edge ai
Stars
161
Readiness
needs review (65/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant apple-silicon desktop-app fine-tuning llm lm-studio

autonomous-ai/autonomous-grid

Your AI intranet: network the computers you already own for inference and training.

Category
local and edge ai
Stars
133
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +21 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai distributed fine-tuning grpo homelab inference

eullm/eullm

Open-source platform for creating, distributing and running sovereign EU-compliant LLMs. Verticalize any model for your domain, language and brand. AI Act ready.

Category
local and edge ai
Stars
54
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-sovereignty data-sovereignty eu-ai-act europe fine-tuning gdpr

ohdearquant/lattice

Run, quantize, and fine-tune LLMs on Apple Silicon. Pure Rust, no Python, no CUDA, no ONNX

Category
local and edge ai
Stars
39
Readiness
ready (72/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon embeddings fine-tuning graphdb inference llm

Yog-Sotho/LLM-fine-tuner

Powerful no-code LLM fine-tuner: upload data → train → deploy in minutes. Unsloth 2-5× acceleration · QLoRA/DPO/RLHF/PPO/ORPO · Reward Model training · GGUF export · vLLM inference · BLEU/ROUGE/BERTSc

Category
local and edge ai
Stars
30
Readiness
needs review (66/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

abliteration ai dpo fine-tuning gguf gradio

botAGI/AGmind-ML

Locally fine-tuned Russian RAG models: document splitter, query expansion, retrieval embedder. Teacher distillation → GGUF → llama.cpp on AMD Vulkan. Commercial-OK licenses.

Category
local and edge ai
Stars
21
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chunking fine-tuning gguf llama-cpp llm lora

transformerlab/transformerlab-app

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

Category
local and edge ai
Stars
5,170
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

diffusion diffusion-models electron llama llms lora

scouzi1966/maclocal-api

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Sup

Category
local and edge ai
Stars
324
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-foundation-models apple-intelligence apple-llm apple-llm-integration apple-silicon

JosefAlbers/phi

Phi-3, -3.5, and -4 for Mac: Locally-run Vision and Language Models for Apple Silicon

Category
local and edge ai
Stars
278
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent finetuning llm lora mac macos

ARahim3/mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

Category
local and edge ai
Stars
1,377
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon deep-learning huggingface large-language-models llm llm-finetuning

armbues/SiLLM

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

Category
local and edge ai
Stars
283
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 417 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon dpo large-language-models llm llm-inference llm-training

dyad-sh/dyad

Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

Category
local and edge ai
Stars
21,134
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +52 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-app-builder anthropic artificial-intelligence bolt deepseek gemini

miurla/morphic

An AI-powered search engine with a generative UI

Category
local and edge ai
Stars
9,029
Readiness
ready (100/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

generative-ai generative-ui nextjs ollama react searxng

mlc-ai/web-llm-chat

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Category
local and edge ai
Stars
1,078
Readiness
needs review (60/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
28/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 170 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chat chat-application chatbot chatgpt gemma

ArvinLovegood/go-stock

🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部保留在本地。支持DeepSeek，OpenAI， Ollama，LMStudio，AnythingLLM，硅基流动，火山方舟，阿里云百炼等平台或模型。

Category
local and edge ai
Stars
7,159
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +74 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-tools deepseek golang lmstudio naiveui ollama

AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/8wGSsvmg4V

Category
local and edge ai
Stars
1,232
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +33 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-chat ai-tools apple-silicon chatgpt deepseek desktop-app

aidatatools/ollama-benchmark

LLM Benchmark for Throughput via Ollama (Local LLMs)

Category
local and edge ai
Stars
382
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 202 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-tools benchmark llm ollama

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Category
local and edge ai
Stars
5,736
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

api-server command-line-tool developer-tools gguf huggingface huggingface-models

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Category
local and edge ai
Stars
5,332
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2,551 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon gemma gemma4 gemma4-26b-a4b gpgpu llm

sauravpanda/BrowserAI

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Category
local and edge ai
Stars
1,448
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agents ai llama llm llm-inference local

eastriverlee/LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

Category
local and edge ai
Stars
868
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gguf ios llm llm-inference macos swift

zeraix/zeraix

Open-source local AI workspace — advancing on-device inference.

Category
local and edge ai
Stars
311
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +78 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-runtime apple-silicon desktop llm llm-inference local-ai

bd4sur/Nano

电子鹦鹉 / Toy Language Model

Category
local and edge ai
Stars
294
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai gpt llm llm-inference llm-training on-device

thushan/olla

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Category
local and edge ai
Stars
269
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai amd golang intel llama-cpp llamacpp

mukel/llama3.java

Llama 3+ inference in pure Java

Category
local and edge ai
Stars
817
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
17/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 105 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatgpt genai gguf huggingface java llama

run-ai/genv

GPU environment and cluster management with LLM support

Category
local and edge ai
Stars
660
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: repository is archived, no push in 813 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

bash container-runtime containers data-science deep-learning docker

TilmanGriesel/chipper

✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)

Category
local and edge ai
Stars
483
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agentic-ai deepseek deepseek-chat deepseek-r1 embedding

orangekame3/mirrormate

Self-hosted personalized AI in a mirror.

Category
local and edge ai
Stars
482
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 212 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai llm-inference local-llm magicmirror ollama raspberry-pi

preternatural-explore/mlx-swift-chat

A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.

Category
local and edge ai
Stars
434
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 649 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ios llm-inference macos mlx mlx-swift swiftui

pguso/agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

Category
local and edge ai
Stars
932
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +13 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-architecture ai-agents ai-education ai-from-scratch artificial-intelligence llama

CoderSJX/AI-Resources-Central

Bringing together outstanding artificial intelligence (AI) open source projects from around the world.

Category
local and edge ai
Stars
1,237
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 560 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent ai chatgpt functioncall gemini llm

intelliswarm-ai/swarm-ai

Spring AI framework for Java that plans, executes, and improves itself — agents detect capability gaps at runtime and generate validated skills on the fly.

Category
local and edge ai
Stars
20
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-orchestration agentic-ai agentic-framework ai-agent-framework ai-agents ai-framework

rockbite/localforge

Local coding agent with neat UI

Category
local and edge ai
Stars
393
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 446 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-agents ai-framework javascript langchain local-llm

mgonzs13/llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

Category
local and edge ai
Stars
260
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

audio cpp embeddings ggml gguf gpt

tryAGI/Ollama

Ollama SDK for .NET

Category
local and edge ai
Stars
205
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai autosdk chat-completion csharp dotnet embeddings

lemony-ai/cascadeflow

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Category
local and edge ai
Stars
3,994
Readiness
ready (98/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +262 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent ai anthropic api budgets claude

kubeai-project/kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Category
local and edge ai
Stars
1,239
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai autoscaler faster-whisper inference-operator k8s kubernetes

nodetool-ai/nodetool

The open-source, agent-first creative workspace.

Category
local and edge ai
Stars
454
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
0/100 · high confidence

Why: +15 stars in 7 days; 100+ commits in 30 days

Why it may be a gem: consistent human and community activity; healthy maintenance and project fundamentals; open issue backlog is stable or shrinking

Strongest signals: push recency, commit activity, contributor breadth. Risks: None identified. Missing inputs: None.

Capped lower bounds: 30-day commits, response activity.

anthropic cerebras cohere deepseek fal gemini

skye-harris/hass_local_openai_llm

Home Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)

Category
local and edge ai
Stars
255
Readiness
ready (94/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents ai-assistant conversation-agent home-assistant homeassistant homeassistant-integration

mudler/vllm.cpp

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features

Category
local and edge ai
Stars
229
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cpp20 llm mlx vllm

defilantech/LLMKube

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, mo

Category
local and edge ai
Stars
186
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon autoscaling edge-computing gguf gpu

BjornMelin/docmind-ai-llm

DocMind AI is a powerful, open-source Streamlit application leveraging LlamaIndex, LangGraph, and local Large Language Models (LLMs) via Ollama, LMStudio, llama.cpp, or vLLM for advanced document anal

Category
local and edge ai
Stars
145
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents document-analysis hybrid-search langchain langgraph-supervisor-py llama-cpp

lordmathis/llamactl

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Category
local and edge ai
Stars
139
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

llama-cpp llama-server llamacpp llm llm-inference llm-router

joeynyc/spark-doctor

Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker issues, and validates vLLM/Ollama/llama.cpp/SGLang recipes.

Category
local and edge ai
Stars
99
Readiness
ready (73/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cli dgx dgx-spark diagnostics gb10 grace-blackwell

automatika-robotics/embodied-agents

EmbodiedAgents is a fully-loaded ROS2 based framework for creating interactive physical agents that can understand, remember, and act upon contextual information from their environment.

Category
local and edge ai
Stars
66
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deeplearning embodied-agent embodied-ai generative-ai godel-machine llm

varunvasudeva1/llm-server-docs

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

Category
local and edge ai
Stars
826
Readiness
needs review (67/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

comfyui debian docker huggingface kokoro-fastapi linux

jakobdylanc/llmcord

Make Discord your LLM frontend - Supports any OpenAI compatible API (OpenRouter, Ollama and more)

Category
local and edge ai
Stars
821
Readiness
ready (77/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

bot chatbot discord discord-bot gemini gpt-5

SimonZeng7108/efficientsam3

EfficientSAM3 compresses SAM3 into lightweight, edge-friendly models via progressive knowledge distillation for fast promptable concept segmentation and tracking.

Category
local and edge ai
Stars
648
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

artificial-intelligence computer-vision edge-ai efficient-ai segment-anything segmentation

vakovalskii/NeuralDeskApp

Versatile Almost Local, Eventually Reasonable Assistant 🔫

Category
local and edge ai
Stars
330
Readiness
needs review (48/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent ai-assistant cross-platform desktop-app function-calling llama

InftyAI/llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Category
local and edge ai
Stars
308
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 193 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

huggingface inference inference-platform kubernetes llamacpp llm

lework/llm-benchmark

LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。

Category
local and edge ai
Stars
271
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +3 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, license. Risks: no push in 240 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

benchmark ollama vllm

1Panel-dev/1Panel

🔥 1Panel is a modern, open-source VPS control panel — and the only one with native AI agent support. Run Ollama models, deploy OpenClaw agents, and manage your entire server stack from one clean web i

Category
local and edge ai
Stars
36,454
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
0/100 · high confidence

Why: +73 stars in 7 days; 100+ commits in 30 days

Why it may be a gem: healthy maintenance and project fundamentals; consistent human and community activity

Strongest signals: push recency, commit activity, contributor breadth. Risks: None identified. Missing inputs: None.

Capped lower bounds: 30-day commits, lifetime contributors, response activity.

agent clawdbot copaw docker docker-ui hermes

AsyncFuncAI/deepwiki-open

Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme

Category
local and edge ai
Stars
17,585
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +78 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai codex gemini github grok-cli ollama

browseros-ai/BrowserOS

🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.

Category
local and edge ai
Stars
12,993
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +142 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent browser browseros chromium hacktoberfest linux

ollama/ollama-python

Ollama Python library

Category
local and edge ai
Stars
10,386
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +25 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ollama python

RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

Category
local and edge ai
Stars
10,302
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android apple-intelligence cpp diffusion-models edge flutter

LearningCircuit/local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encry

Category
local and edge ai
Stars
8,861
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +35 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

academia anthropic arxiv brave deep-research encryption

n4ze3m/page-assist

Use your locally running AI models to assist you in your web browsing

Category
local and edge ai
Stars
8,125
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +32 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chat-application chrome-extension localllm ollama open-source

OpenCoworkAI/open-codesign

Open-source Claude Design alternative. One-click import your Claude Code / Codex API key. Prompt → prototype / slides / PDF. Multi-model (Claude, GPT, Gemini, Kimi, GLM, Ollama). BYOK, local-first, MI

Category
local and edge ai
Stars
7,680
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +52 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-design anthropic byok claude claude-code claude-design

JerryZLiu/Dayflow

The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.

Category
local and edge ai
Stars
6,828
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +23 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt claude gemini llm lmstudio

vas3k/TaxHacker

Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories

Category
local and edge ai
Stars
6,589
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +27 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

accounting ai-analysis currency-exchange expenses gemini invoices

Andyyyy64/whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Category
local and edge ai
Stars
6,164
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +87 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon benchmarks cli command-line-tool gguf

clusterzx/paperless-ai

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Category
local and edge ai
Stars
5,883
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +33 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai automation gemma llama mistral ollama

buxuku/SmartSub

视频转字幕、字幕翻译、AI 配音与声音克隆、字幕烧录——免费开源的一站式桌面工具。基于 Whisper / FunASR 等本地模型离线语音转文字，批量处理 + 全平台 GPU 加速，跨 Windows / macOS / Linux。Free, open-source desktop app to generate, translate, dub & burn video subtitles —

Category
local and edge ai
Stars
4,486
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +82 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deepseek faster-whisper fireredasr funasr ollama openai

umlx5h/LLPlayer

The media player for language learning, with dual subtitles, AI-generated subtitles, real-time translation, and more!

Category
local and edge ai
Stars
4,004
Readiness
needs review (69/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +28 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

asr csharp flyleaf language-learning llm media-player

yuruotong1/autoMate

Like Manus, Computer Use Agent(CUA) and Omniparser, we are computer-using agents.AI-driven local automation assistant that uses natural language to make computers work by themselves

Category
local and edge ai
Stars
3,940
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent ai computeruse deepseek manus ollama

OvidijusParsiunas/deep-chat

Fully customizable AI chatbot component for your website

Category
local and edge ai
Stars
3,690
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-chatbot chat chatbot chatgpt claude

deta/surf

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

Category
local and edge ai
Stars
3,511
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +8 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

claude deepseek gemma knowledge-base knowledge-management llm

xyproto/algernon

Small self-contained pure-Go web server with Lua, Teal, Markdown, HTTP/2, QUIC, Redis, TypeScript, React 19, SQLite, and PostgreSQL support ++

Category
local and edge ai
Stars
3,023
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

algernon build-less cross-platform fasthttp go http3

ax-llm/ax

The pretty much "official" DSPy framework for Typescript

Category
local and edge ai
Stars
2,860
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai anthropic claude cohere dspy gemini

control-theory/gonzo

Gonzo! The Go based TUI log analysis tool

Category
local and edge ai
Stars
2,745
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai golang logs ollama openai opentelemetry

Mobile-Artificial-Intelligence/maid

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

Category
local and edge ai
Stars
2,623
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android anthropic chatbot chatgpt claude deepseek

icereed/paperless-gpt

Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI

Category
local and edge ai
Stars
2,606
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +13 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt llm mistral ocr ollama

ggozad/oterm

the terminal client for LLMs

Category
local and edge ai
Stars
2,414
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

llm llms machine-learning ollama python terminal

heshengtao/comfyui_LLM_party

LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,

Category
local and edge ai
Stars
2,327
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +8 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent comfyui dify flux gemini gguf

hydropix/TranslateBooksWithLLMs

Translate full-length books and documents with Ollama, OpenAI (comptatible), Gemini, Mistral, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.

Category
local and edge ai
Stars
2,263
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +22 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

docx epub gemini gemini-api llm lmstudio

harry0703/AudioNotes

快速提取音视频内容，整理成一份结构化的markdown笔记

Category
local and edge ai
Stars
2,251
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +15 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai asr funasr ollama python qwen2

antoinezambelli/forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

Category
local and edge ai
Stars
2,212
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai agentic-workflow agents function-calling llama-cpp llamafile

kubewall/kubewall

kubewall - Single-Binary Kubernetes Dashboard with Multi-Cluster Management & AI Integration. (OpenAI / Claude 4 / Gemini / DeepSeek / OpenRouter / Ollama / Qwen / LMStudio)

Category
local and edge ai
Stars
1,924
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt cloud-native dashboard developer-tools devops

cogwheel0/conduit

Native iOS and Android client for Open WebUI, plus direct OpenAI-compatible, Ollama, and OpenRouter connections and self-hosted Hermes agents.

Category
local and edge ai
Stars
1,913
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +60 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents ai-assistant android chat chatbot cross-platform

sammcj/gollama

Go manage your Ollama models

Category
local and edge ai
Stars
1,830
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ggml gguf linux llm macos

Jeffser/Alpaca

🦙 Local and online AI hub

Category
local and edge ai
Stars
1,614
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

adwaita flatpak gnome gtk4 ollama ollama-api

RayBytes/ChatMock

OpenAI & Ollama compatible API powered by Codex

Category
local and edge ai
Stars
1,526
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt codex gpt-5 ollama openai

awaescher/OllamaSharp

The easiest way to use Ollama in .NET

Category
local and edge ai
Stars
1,394
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai gpt ichatclient library llama llamacpp

HelgeSverre/ollama-gui

A Web Interface for chatting with your local LLMs via the ollama API

Category
local and edge ai
Stars
1,253
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai gui ollama

kellyvv/PhoneClaw

PhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.

Category
local and edge ai
Stars
1,202
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-framework ai-agent gemma ios litert local-agent

agents-flex/agents-flex

Agents-flex is A lightweight Java AI agent development framework (positioned as a counterpart to Spring AI). It supports features such as RAG, MCP, Skills, Text2SQL , LLM Wiki, Sub-agents, Web Search,

Category
local and edge ai
Stars
1,058
Readiness
ready (94/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent ai chatbot chatgpt gpt langchain4j

lss233/kirara-ai

🤖 可 DIY 的 多模态 AI 聊天机器人 | 🚀 快速接入 微信、 QQ、Telegram、等聊天平台 | 🦈支持DeepSeek、Grok、Claude、Ollama、Gemini、OpenAI | 工作流系统、网页搜索、AI画图、人设调教、虚拟女仆、语音对话 |

Category
local and edge ai
Stars
18,898
Readiness
needs review (46/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +16 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 405 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

bard bot chatglm-6b chatgpt deepseek discord

GaiZhenbiao/ChuanhuChatGPT

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

Category
local and edge ai
Stars
15,294
Readiness
needs review (48/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
17/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 99 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatbot chatglm chatgpt-api claude dalle3 ernie

gluonfield/enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Category
local and edge ai
Stars
5,983
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ios large-language-model llama llama2 llm mistral

ollama/ollama-js

Ollama JavaScript library

Category
local and edge ai
Stars
4,332
Readiness
needs review (50/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
28/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: no push in 170 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

javascript js ollama

gofireflyio/aiac

Artificial Intelligence Infrastructure-as-Code Generator.

Category
local and edge ai
Stars
3,784
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 136 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai amazon-bedrock chatgpt iac llms ollama

rashadphz/farfalle

🔍 AI search engine - self-host with local or cloud LLMs

Category
local and edge ai
Stars
3,540
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 679 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

fastapi generative-ui gpt-4o groq llm nextjs

sherlockchou86/VideoPipe

A cross-platform video structuring (video analysis) framework based on CV models & mLLM.

Category
local and edge ai
Stars
2,888
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
27/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 163 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai behaviour-analysis cv deep-learning deepstream face-recognition

aingdesk/AingDesk

AingDesk是一款简单好用的AI助手，支持知识库、模型API、分享、联网搜索、智能体，它还在飞快成长中。 AingDesk is a simple and easy-to-use AI assistant that supports knowledge bases, model APIs, sharing, internet search, and intelligent agents. It

Category
local and edge ai
Stars
2,529
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +7 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deepseek electron llm localai nodejs ollama

darrenburns/elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Category
local and edge ai
Stars
2,479
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 666 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt claude gemma gpt large-language-models

semanser/codel

✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

Category
local and edge ai
Stars
2,471
Readiness
needs review (45/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 830 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent ai autonomous-agents bot devin llama2

nikmcfly/MiroFish-Offline

Offline multi-agent simulation & prediction engine. English fork of MiroFish with Neo4j + Ollama local stack.

Category
local and edge ai
Stars
2,465
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 136 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai multi-agent neo4j offline ollama open-source

prism-php/prism

A unified interface for working with LLMs in Laravel

Category
local and edge ai
Stars
2,406
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: +6 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 140 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai anthropic claude hacktoberfest laravel llm

techjarves/Portable-AI-USB

A 100% offline, fully portable, zero-trace AI (Ollama + Llama 3 + AnythingLLM) that runs natively from a USB drive on Windows and Mac.

Category
local and edge ai
Stars
2,220
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
70/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, license. Risks: repository is archived. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ollama portable-ai usb-drive

ozgrozer/ai-renamer

A Node.js CLI that uses Ollama and LM Studio models (Llava, Gemma, Llama etc.) to intelligently rename files by their contents

Category
local and edge ai
Stars
2,107
Readiness
high risk (44/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 544 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai automation cli-tool file-management file-renamer files

travisvn/openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

Category
local and edge ai
Stars
2,023
Readiness
needs review (48/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 402 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai azure chatgpt claude edge-tts elevenlabs

kevinhermawan/Ollamac

Mac app for Ollama

Category
local and edge ai
Stars
1,911
Readiness
high risk (43/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: limited evidence; inspect maintenance signals before adopting

Strongest signals: issue load, documentation. Risks: no push in 513 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai llama3 llm llma llma2 llms

JHubi1/ollama-app

A modern and easy-to-use client for Ollama

Category
local and edge ai
Stars
1,794
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android app linux llama localai

jakobhoeg/nextjs-ollama-llm-ui

Fully-featured web interface for Ollama LLMs

Category
local and edge ai
Stars
1,420
Readiness
needs review (61/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 428 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatbot gemma llm local localstorage

mythrantic/ollama-docker

Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment

Category
local and edge ai
Stars
1,413
Readiness
needs review (45/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +6 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

docker docker-compose ollama

vercel/modelfusion

The TypeScript library for building AI applications.

Category
local and edge ai
Stars
1,319
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 749 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai artificial-intelligence chatbot claude dall-e embedding

Taewan-P/gpt_mobile

Chat app for Android that supports answers from multiple LLMs at once. Bring your own API key AI client. Supports OpenAI, Anthropic, Google, and Ollama. Designed with Material3 & Compose.

Category
local and edge ai
Stars
1,186
Readiness
needs review (59/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android anthropic chatbots chatgpt claude collaborate

fmaclen/hollama

A minimal LLM chat app that runs entirely in your browser

Category
local and edge ai
Stars
1,171
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 299 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatbot llm local-ai ollama

NativeMindBrowser/NativeMindExtension

NativeMind: Your fully private, open-source, on-device AI assistant

Category
local and edge ai
Stars
1,114
Readiness
needs review (45/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: +24 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 137 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chrome-extension llm local-ai nativemind offline-ai

alishobeiri/thread-notebook

AI-powered Jupyter Notebook. Use AI to generate and edit code cells, automatically fix errors, and chat with your data

Category
local and edge ai
Stars
1,106
Readiness
high risk (43/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +1 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai analysis analytics data-science jupyter jupyter-notebook

BruceMacD/chatd

Chat with your documents using local AI

Category
local and edge ai
Stars
1,080
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 762 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chat desktop electron llama2 llm mistral

transcriptionstream/transcriptionstream

turnkey self-hosted offline transcription and diarization service with llm summary

Category
local and edge ai
Stars
944
Readiness
high risk (44/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 201 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

automation diarization llm mistral-7b ollama speaker-diarization

pikpikcu/airecon

AIRecon is an autonomous cybersecurity agent that combines a self-hosted Large Language Model (Ollama) with a Kali Linux Docker sandbox and a Textual TUI. It is designed to automate security assessmen

Category
local and edge ai
Stars
806
Readiness
needs review (65/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents automation bugbounty cli ollama penetration-testing

jmerelnyc/Talos

GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.

Category
local and edge ai
Stars
798
Readiness
needs review (69/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai distributed-computing gpu llm ollama python

kytmanov/obsidian-llm-wiki-local

Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

Category
local and edge ai
Stars
795
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

git-based-wiki karpathy knowledge-base llm-knowledge-base llm-pipeline llm-tools

manparvesh/yoda

Wise and powerful personal assistant, available in your nearest terminal

Category
local and edge ai
Stars
749
Readiness
needs review (47/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 384 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chat chatbot cli devtools hacktoberfest

if-ai/ComfyUI-IF_AI_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation

Category
local and edge ai
Stars
701
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 326 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

anthropic comfyui flux gemini graphrag groq

instavm/clickclickclick

Autonomous Android and computer use using any LLM (local or remote)

Category
local and edge ai
Stars
696
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
24/100 · low confidence

Why: +4 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 143 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agents ai-agents-framework android-automation antrophic computer-use framework

pythops/tenere

🤖 TUI for LLMs

Category
local and edge ai
Stars
679
Readiness
high risk (43/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatgpt cli llamacpp llm ollama ratatui

travisvn/chatterbox-tts-api

Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)

Category
local and edge ai
Stars
661
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +29 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 228 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai chatgpt chatterbox cuda docker elevenlabs

OwlAIProject/Owl

A personal wearable AI that runs locally

Category
local and edge ai
Stars
654
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +3 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 873 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ble bluetooth esp32 llama2 mistral

runebookai/tome

a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

Category
local and edge ai
Stars
627
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
16/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 291 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gemini llm llm-client llms local-llm localai

iagooar/qqqa

Fast, stateless LLM for your shell: qq answers; qa runs commands

Category
local and edge ai
Stars
625
Readiness
needs review (61/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai claude cli codex gpt-oss-120b groq

cognitivetech/ollama-ebook-summary

LLM for Long Text Summary (Comprehensive Bulleted Notes)

Category
local and edge ai
Stars
623
Readiness
high risk (41/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
22/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 398 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

generative-ai gpt llm localai localgpt ollama

win4r/GraphRAG4OpenWebUI

GraphRAG4OpenWebUI integrates Microsoft's GraphRAG technology into Open WebUI, providing a versatile information retrieval API. It combines local, global, and web searches for advanced Q&A systems and

Category
local and edge ai
Stars
604
Readiness
needs review (60/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 574 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aiagents graphrag llms ollama openai openwebui

xNul/code-llama-for-vscode

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

Category
local and edge ai
Stars
571
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 737 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

assistant code code-llama codellama continue continuedev

hooosberg/WitNote

WitNote is a local-first AI writing companion for macOS and Windows.

Category
local and edge ai
Stars
563
Readiness
high risk (39/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
18/100 · low confidence

Why: +11 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 107 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-writing ai-writing-assistant electron i18n local-ai local-first

AntonyCheng/spring-boot-init-template

基于 Java Web 项目的 SpringBoot 框架初始化模板，适配最新版本Spring AI，该模板整合了常用的框架（Mybatis-Plus、ShardingSphere、Redis、RabbitMQ、Elasticsearch、SaToken、OSS、Caffeine以及MongoDB等），广泛支持JDK11和JDK17，部分版本兼容JDK8，同时该模板适用于前后端分离项目启动开发，保

Category
local and edge ai
Stars
542
Readiness
needs review (60/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +5 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

caffeine elastic minio mongodb mybatis-plus ollama

longy2k/obsidian-bmo-chatbot

Generate and brainstorm ideas while creating your notes using Large Language Models (LLMs) from Ollama, LM Studio, Anthropic, Google Gemini, Mistral AI, OpenAI, and more for Obsidian.

Category
local and edge ai
Stars
534
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +3 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 694 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

anthropic-claude mistralai obsidian-plugin ollama openai-api

apeatling/ollama-voice-mac

Mac compatible Ollama Voice

Category
local and edge ai
Stars
518
Readiness
needs review (47/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 351 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai assistant chatbot llm macos mistral

jasonjmcghee/plock

From anywhere you can type, query and stream the output of any script (e.g. an LLM)

Category
local and edge ai
Stars
503
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 847 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

bash command context cross-platform gpt llm

fynnfluegge/codeqai

Local first semantic code search and chat | Leverage custom copilots with fine-tuning datasets from code in Alpaca, Conversational, Completion and Instruction format

Category
local and edge ai
Stars
493
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 238 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

codellama faiss gpt huggingface langchain llama2

LiberSonora/LiberSonora

LiberSonora，寓意“自由的声音”，是一个 AI 赋能的、强大的、开源有声书工具集，包含智能字幕提取、AI标题生成、多语言翻译等功能，支持 GPU 加速、批量离线处理。LiberSonora, meaning "The Voice of Freedom," is an AI-powered robust open-source audiobook toolkit.

Category
local and edge ai
Stars
466
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
21/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 373 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

audio-books deepseek llm ollama subtitle subtitles-generator

KolosalAI/kolosal-cli

Super lightweight Ollama + Qwen Code alternative to run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

Category
local and edge ai
Stars
464
Readiness
needs review (50/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 226 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents cli coding deepseek gemma

lookr-fyi/job-application-bot-by-ollama-ai

The world’s #1 end-to-end job agent: semantic filters, ATS-optimized resumes, referrals from hiring managers — 100% hands-free.

Category
local and edge ai
Stars
460
Readiness
high risk (39/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
26/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 157 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

browser-automation job-search-automation ollama on-device-ai

vorojar/Folio-OCR

Open-source batch OCR workbench — a free, local alternative to ABBYY FineReader. Powered by Ollama + GLM-OCR + PP-DocLayoutV3, ~0.5s/page on RTX 4090. Three-panel editor, layout-aware, PDF/image batch

Category
local and edge ai
Stars
457
Readiness
needs review (63/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

abbyy-alternative batch-ocr book-digitization document-ocr document-processing glm-ocr

mattt/ollama-swift

A Swift client library for interacting with Ollama. Supports structured outputs, tool use, and vision models.

Category
local and edge ai
Stars
453
Readiness
needs review (47/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: no push in 379 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ollama swift

filipstrand/mflux

MLX native implementations of state-of-the-art generative image models

Category
local and edge ai
Stars
2,268
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon diffusers fibo flux huggingface

zhongkaifu/TensorSharp

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It suppor

Category
local and edge ai
Stars
346
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +89 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai csharp cuda cuda-programming deepseek-v4 dotnet

0hq/WebGPT

Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.

Category
local and edge ai
Stars
3,793
Readiness
high risk (41/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 938 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gpt nanogpt transformers webgpu

beclab/Olares

Open-Source Personal Cloud OS for Always-On Agents

Category
local and edge ai
Stars
5,166
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +67 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai ai-agents cloud-native data-privacy edge-ai homelab

defai-digital/ax-engine

One Mac process. Many models. Real speed. Multi-model LLM serving with prefix reuse, MTP acceleration, and OpenAI APIs — built for Apple Silicon, measured against mlx-lm and llama.cpp.

Category
local and edge ai
Stars
21
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon embeddings gemma homebrew llm local-ai

mozilla-ai/llamafile

Distribute and run LLMs with a single file.

Category
local and edge ai
Stars
25,512
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +36 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cross-platform gguf llama-cpp local-ai local-inference local-llm

maziyarpanahi/openmed

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network.

Category
local and edge ai
Stars
4,940
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +165 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android clinical-nlp healthcare hipaa ios javascript

raullenchai/Rapid-MLX

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replace

Category
local and edge ai
Stars
3,418
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +31 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon claude-code cursor deepseek fastapi hacktoberfest

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server, 65 tok/s Qwen 3.5 122B, Llama 3.3 70B, Gemma 4 31B. Private, offline, airgap-ready. Built for NDA / lega

Category
local and edge ai
Stars
3,163
Readiness
ready (97/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +152 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

abliterated ai-privacy airgap ambient-computing anthropic apple-silicon

rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

Category
local and edge ai
Stars
2,499
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +31 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai awesome awesome-list llm local local-ai

fikrikarim/parlor

On-device, real-time multimodal AI with features similar to GPT-Live

Category
local and edge ai
Stars
1,963
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +48 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon gemma kokoro litert-lm local-llm mlx

AtomicBot-ai/atomic-agent

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.

Category
local and edge ai
Stars
1,637
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +547 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agents ai-agent browser-automation cli gguf hermes-agent

jofizcd/Soul-of-Waifu

🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adven

Category
local and edge ai
Stars
1,127
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +140 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-companion ai-girlfriend ai-roleplay ai-rpg-engine ai-vtuber

PurpleDoubleD/locally-uncensored

Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs + ComfyUI 100% offline. One installer, no Docker, no cloud.

Category
local and edge ai
Stars
1,024
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +39 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

abliterated agent-mode ai ai-chat comfyui desktop-app

razzant/ouroboros

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

Category
local and edge ai
Stars
1,000
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +260 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent autonomous-agent background-consciousness coding-agent computer-use desktop-agent

axoviq-ai/synthadoc

Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-

Category
local and edge ai
Stars
862
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-skills agentic-ai cli-tool domain-adaptation enterprise enterprise-solutions

Pangu-Immortal/MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.

Category
local and edge ai
Stars
845
Readiness
ready (100/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android android-17 edge-ai jetpack-compose kotlin local-llm

kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

Category
local and edge ai
Stars
817
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon gpu llama-cpp llm lm-studio local-llm

jegly/Box

The most advanced, fully offline client-side AI suite on Android today.

Category
local and edge ai
Stars
734
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +21 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android android-ai-app artificial-intelligence box gguf linux

gavamedia/deltafin

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

Category
local and edge ai
Stars
719
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +181 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

kimi kimi-k3 local-ai local-llm

openyak/openyak

Open-source local-first AI agent for desktop work. No account, no telemetry: use local models with Ollama/Rapid-MLX or bring your own provider key.

Category
local and edge ai
Stars
701
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agentic-ai ai-agent ai-coding-assistant byok claude-code-alternative

onetoken-oss/K3Flight

Run Kimi K3 locally on CPU with ~55GB measured runtime RAM. A single-file Linux inference server powered by cPilot Runtime.

Category
local and edge ai
Stars
669
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cpu-inference edge-ai inference-engine kimi-k3 local-llm low-memory

ddalcu/mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Category
local and edge ai
Stars
530
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +136 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent anthropic-api apple-silicon claude-code deepseek-v4 diffusion

heider-x/vela

AI-powered IDE for novel writing — local LLM + RAG, privacy-first, BYOK. For web fiction authors and creative writers.

Category
local and edge ai
Stars
508
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +15 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-tool ai-writing creative-writing desktop-app electron local-llm

john-rocky/coreai-model-zoo

Community model zoo for Apple Core AI (iOS/macOS 27): 57 models — LLM, VLM, OCR, ASR, TTS, image/video/music gen, forecasting — each gated against its source model and shipped with the recipe that pro

Category
local and edge ai
Stars
380
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon coreai coreml gemma4 granite

1ay1/agentty

AI pair programming in your terminal — one static binary, sub-ms startup, any model

Category
local and edge ai
Stars
369
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

acp agentic-coding ai-agent airgap anthropic claude

inclusionAI/AReno

An easy-to-use, fast toolkit to scale up RL post-training on a single node.

Category
local and edge ai
Stars
272
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +13 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agentic-ai grpo llm local-ai local-llm

raketenkater/ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Category
local and edge ai
Stars
262
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cuda gguf golang inference-server llama-cpp llamacpp

hogeheer499-commits/strix-halo-guide

AMD Strix Halo / Ryzen AI Halo local LLM setup and benchmark guide for Ryzen AI MAX+ 395 and Radeon 8060S: Ollama, llama.cpp Vulkan/RADV, ROCm, 101 t/s Qwen3-Coder, CHADROCK MTP, 120B GGUF, and raw ev

Category
local and edge ai
Stars
261
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

amd beelink benchmark framework-desktop gfx1151 gguf

H4D3ZS/vscodium-rust

AI-native IDE with agentic workflows, iPhone emulation on Windows/Linux, PyTorch ML Studio, and ROCm-optimized local AI. Built for security researchers and cross-platform developers.

Category
local and edge ai
Stars
244
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai amd artificial-intelligence bug-bounty cross-platform cybersecurity

kytmanov/synto

More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

Category
local and edge ai
Stars
228
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

git-based-wiki karpathy knowledge-base llm-knowledge-base llm-pipeline llm-tools

mohitsoni48/TurboLLM

Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.

Category
local and edge ai
Stars
220
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +29 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai anthropic-api claude-code gguf gpu inference

codehamr/codehamr

A minimal, local-first coding agent for the terminal.

Category
local and edge ai
Stars
207
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent coding-agent local-llm

Leon-Sander/Local-Multimodal-AI-Chat

Self-hostable multimodal chat with local LLMs (Ollama/OpenAI): PDF RAG, image chat, and Whisper voice, Streamlit + Docker.

Category
local and edge ai
Stars
205
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chromadb docker langchain llm local-llm multimodal

jegly/OfflineLLM

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Accel

Category
local and edge ai
Stars
200
Readiness
needs review (66/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android android-ai android-ai-app android-llm artificial-intelligence edge-ai

michaelwilhelmsen/humla

Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via OpenAI / Deepgram / Groq, identifies speakers offline, and writes summaries that fuse your no

Category
local and edge ai
Stars
195
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +20 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon granola-alternative local-first local-llm macos

mercurialsolo/claudectl

Orchestrate a swarm of Claude Code agents with a local brain that learns from you.

Category
local and edge ai
Stars
195
Readiness
needs review (69/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-orchestration claude claude-code cli coding-agent hive-mind

giannisanni/pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs. Zero-config multi-GPU: measures PCIe bandwidth, places att

Category
local and edge ai
Stars
193
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cuda gguf glm inference-engine llm local-llm

bagidea/bagidea-office

A living AI-agent office on your desktop wallpaper — Claude Code agents that walk, work, delegate, learn & hold meetings. Per-agent swappable models (Claude/GLM/DeepSeek/Qwen/Kimi/OpenAI/Gemini/Groq/O

Category
local and edge ai
Stars
186
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-orchestration ai ai-agents anthropic automation autonomous-agents

notatestuser/ds4-control

macOS menu bar app for ds4: fast DeepSeek V4 Pro/Flash, with 1M context.

Category
local and edge ai
Stars
172
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deepseek deepseek-v4 deepseek-v4-flash deepseek-v4-pro ds4 dwarfstar

HMDSimDev/heartmorrow

LLM-powered dating simulator

Category
local and edge ai
Stars
165
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai dating-simulator game llm llms local-ai

mlx-node/mlx-node

No description

Category
local and edge ai
Stars
152
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cuda llm local-llm mlx

endend2003-cmd/Tactical-Matrix-Console

WarMatrix 2026: Next-Gen Tactical Simulation & AI Command Console

Category
local and edge ai
Stars
150
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-simulation command-and-control defence-technology fastapi glassmorphism local-llm

Likhithsai2580/JARVIS

Project Jarvis is a versatile AI assistant that integrates various functionalities.

Category
local and edge ai
Stars
143
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents assistant g4f gui jarvis

BodhiSearch/BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Category
local and edge ai
Stars
136
Readiness
needs review (69/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gemma generative-ai llama llm local-llm localllm

Deno2026/comfyui-deno-custom-nodes

ComfyUI custom nodes for RTX Video Super Resolution, NVIDIA VFX/nvvfx, LTX 2.3, Bernini Prompt Guide, Wan2.2 reference video edit, image/video compare, video preview, loaders, resize, and visual workf

Category
local and edge ai
Stars
131
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

bernini bernini-prompt-guide comfyui comfyui-custom-nodes custom-nodes ideogram

SyntheticAutonomicMind/SAM

Synthetic Autonomic Mind - An AI assistant for everyone.

Category
local and edge ai
Stars
131
Readiness
ready (77/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant ai-assistants ai-tools apple apple-silicon artificial-intelligence

HybridAIOne/hybridclaw

Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials, approvals, and memory

Category
local and edge ai
Stars
126
Readiness
ready (73/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-agents anthropic chatgpt claude-code clawdbot

hirokawaguchi/open-genai

デジタル庁のガバメントAI「源内(GENAI)」を完全ローカル(ローカルLLM/OpenAI互換)で動かす非公式プロジェクト。SAML認証(Keycloak)・RAG(Qdrant)・文字起こし(Whisper)・画像生成(SD)・チーム単位ナレッジをローカル完結。

Category
local and edge ai
Stars
125
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

digital-agency fastapi genai japan keycloak local-llm

techjarves/USB-Uncensored-LLM

The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux),

Category
local and edge ai
Stars
1,959
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
70/100 · low confidence

Why: +18 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest. Risks: repository is archived. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

local-llm portable-ai uncensored-ai

withcatai/catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀

Category
local and edge ai
Stars
498
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
22/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 264 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-assistant catai chatbot chatgpt chatui

lxe/llavavision

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Category
local and edge ai
Stars
496
Readiness
high risk (40/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 983 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai artificial-intelligence computer-vision llama llamacpp llm

mantisfury/ArkhamMirror

Local-first AI-powered document intelligence platform for investigative journalism

Category
local and edge ai
Stars
482
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +31 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 194 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

air-gapped data-visualization digital-forensics docker document-intelligence edge-ai

resume-llm/resume-ai

A local, privacy-first résumé builder using LLMs and Markdown to generate ATS-ready DOCX files with Pandoc — no cloud, no tracking.

Category
local and edge ai
Stars
391
Readiness
needs review (58/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-resume-builder local-llm resume-builder

dineshsoudagar/local-llms-on-android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Category
local and edge ai
Stars
376
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
15/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 93 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android android-app chatbot gemma4 gemma4-2b gemma4-e4b

deveix/react-native-apple-llm

React Native Apple LLM plugin using Foundation Models

Category
local and edge ai
Stars
341
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 202 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-foundation-models apple-intelligence apple-llm apple-llm-integration foundation-models local-llm

shreyaskarnik/DistiLlama

Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐

Category
local and edge ai
Stars
304
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 704 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chrome-extension langchain llama2 llms local-llm mistral-7b

emirsahin1/llm-axe

A simple, intuitive toolkit for quickly implementing LLM powered applications.

Category
local and edge ai
Stars
275
Readiness
needs review (56/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 579 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

function-calling llama3 llm local-llm ollama pdf-llm

vscode-reborn-ai/vscode-reborn-ai

Code with AI in VSCode, bring your own ai.

Category
local and edge ai
Stars
268
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
23/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 141 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai gpt-4o gpt-o1 hacktoberfest local-llm openrouter

kstonekuan/simple-chromium-ai

TypeScript library for Local LLM in Chromium browsers

Category
local and edge ai
Stars
265
Readiness
needs review (59/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

browser-extension chrome chrome-extension chromium gemini-nano-in-chrome local-llm

datacrystals/AIStoryWriter

LLM story writer with a focus on high-quality long output based on a user provided prompt.

Category
local and edge ai
Stars
258
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 256 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai command-line-tool llm llms local-llama local-llm

AstraBert/everything-ai

Your fully proficient, AI-powered and local chatbot assistant🤖

Category
local and edge ai
Stars
250
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: repository is archived, no push in 780 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-studio chatgpt cheshire-cat docker-image free-to-use

fiveoutofnine/whatcanirun

Find the best models and how to run them locally.

Category
local and edge ai
Stars
245
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
16/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 95 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon llamacpp llm local-llm mlx

newideas99/open-dungeon

Open Dungeon — the first easy-to-use, fully local AI roleplay app. Story and inline scene images generated 100% on your machine (Gemma 4 QAT via Ollama(and others) + FLUX). No accounts, no API keys, n

Category
local and edge ai
Stars
213
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gemma image-generation interactive-fiction local-llm nextjs ollama

quelmap-inc/quelmap

Open Source Local Data Analysis Assistant.

Category
local and edge ai
Stars
202
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: no push in 291 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

data-analysis data-analysis-agent data-science local-ai-agents local-llm open-source

nats-io/nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.

Category
local and edge ai
Stars
20,407
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +36 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cloud cloud-computing cloud-native connected-vehicle distributed-systems edge

ultralytics/yolov3

PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

Category
local and edge ai
Stars
10,589
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

computer-vision coreml deep-learning edge-ai inference model-export

google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Category
local and edge ai
Stars
6,126
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +64 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai on-device-ai on-device-llm

off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. R

Category
local and edge ai
Stars
2,882
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +31 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android edge-ai gguf ios llama-cpp local-ai

microsoft/Biodiversity

Microsoft AI for Good Lab — Biodiversity research hub. Open-source AI models, edge devices, and tools for biodiversity monitoring and conservation. Your source for MegaDetector, SPARROW, PytorchWildli

Category
local and edge ai
Stars
1,065
Readiness
ready (97/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-for-good animal-detection bioacoustics biodiversity camera-traps computer-vision

sourcenetwork/defradb

DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.

Category
local and edge ai
Stars
887
Readiness
needs review (66/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

crdt database distributed documentdb edge-ai edge-compute

sipeed/MaixPy

Easily create AI projects with Python on edge device

Category
local and edge ai
Stars
833
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-vision edge-ai embedded maixcam maixcam-pro

qijianpeng/awesome-edge-computing

A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.

Category
local and edge ai
Stars
517
Readiness
ready (78/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

awesome-list edge-ai edge-computing edge-intelligence emulation fog-computing

SonySemiconductorSolutions/mct-model-optimization

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers adva

Category
local and edge ai
Stars
449
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
0/100 · high confidence

Why: +1 stars in 7 days; 34 lifetime contributors

Why it may be a gem: healthy maintenance and project fundamentals; open issue backlog is stable or shrinking

Strongest signals: push recency, contributor breadth, issue load. Risks: None identified. Missing inputs: None.

deep-learning deep-neural-networks edge-ai machine-learning network-compression network-quantization

cosmo-wander-ai/cosmo-edge

Production-grade C++ edge AI engine for video analytics with visual pipeline orchestration, on-device VLM, and real-time OSD.

Category
local and edge ai
Stars
424
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
high
Maintainer health
healthy
Maintenance risk
8/100 · high confidence

Why: +84 stars in 7 days; 100+ commits in 30 days

Why it may be a gem: healthy maintenance and project fundamentals; consistent human and community activity

Strongest signals: push recency, commit activity, issue load. Risks: no pull-request review responses in 30 days. Missing inputs: None.

Capped lower bounds: 30-day commits.

bm1688 computer-vision cpp17 edge-ai grounding-dino on-device-ai

google-ai-edge/litert-samples

LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

Category
local and edge ai
Stars
391
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai generative-ai on-device-ai

xybrid-ai/xybrid

Build apps powered by on-device AI

Category
local and edge ai
Stars
330
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-games edge-ai ios kotlin llamacpp llm

FasterAI-Labs/fasterai

FasterAI: Prune and Distill your models with FastAI and PyTorch

Category
local and edge ai
Stars
265
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deep-learning distillation edge-ai fastai model-compression neural-network

ai-hpc/ai-hardware-engineer-roadmap

Master AI inference, AI agent harness systems, and hardware engineering — then design a physical AI chip. That is the goal.

Category
local and edge ai
Stars
248
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-accelerators ai-agents ai-hardware autonomous-vehicles computer-architecture computer-vision

Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. A 284B on a 12 GB phone, CPU only, lossless, on stock llama.cpp

Category
local and edge ai
Stars
239
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +124 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android cpp edge-ai gemma gguf gpt-oss

Iam5tillLearning/OpenSource-Ai-Glasses

Open-source standalone AI glasses platform built on embedded Linux, with system-level customization, C/C++ SDK, RTSP video streaming, BLE, audio, camera, and optional display support.

Category
local and edge ai
Stars
229
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +8 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-glasses bluetooth computer-vision cpp-sdk edge-ai embedded-linux

wmaslonek/guardian-db

GuardianDB: High-performance, local-first decentralized database that stores and processes data, built on Rust and Iroh

Category
local and edge ai
Stars
205
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

blobs crdt database decentralization distributed edge

ArgoHA/D-FINE-seg

D-FINE-seg Object Detection and Segmentation Framework (Train, Export, Inference)

Category
local and edge ai
Stars
192
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deep-learning detr edge-ai instance-segmentation object-detection pytorch

machinefi/trio-retina

Model-agnostic state layer for world models — turn any detector (YOLO · VLM · DINO) into one standard, queryable stream of events + latent state. numpy-only, runs on CPU at the edge.

Category
local and edge ai
Stars
186
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

computer-vision edge-ai event-stream object-detection object-tracking perception

NVIDIA/DeepStream

NVIDIA DeepStream Monorepo: DeepStream SDK and reference apps for building GPU‑accelerated, real-time video and multi‑sensor analytics pipelines with GStreamer, TensorRT, and vision AI models across e

Category
local and edge ai
Stars
183
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +14 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

computer-vision cuda deepstream-sdk edge-ai embedded-systems gpu-accelerated

ferranpons/Llamatik

True on-device AI for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM, Speech-to-Text and Image Generation — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

Category
local and edge ai
Stars
171
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android desktop edge-ai ggml inference

scaleoutsystems/scaleout-client

Scaleout Edge: Sovereign Edge AI orchestration and Federated Learning

Category
local and edge ai
Stars
169
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai edge-ml federated-learning federated-machine-learning fedml fleet-learning

mozilla-ai/encoderfile

Distribute and run transformer encoders with a single file.

Category
local and edge ai
Stars
127
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai embeddings encoder grpc local-ai nlp

ceva-ip/DPDFNet

Clean up noisy speech in real time with DPDFNet - open-source streaming speech enhancement for research, audio apps, and edge devices. Includes pretrained models, PyTorch code, ONNX/TFLite inference,

Category
local and edge ai
Stars
125
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

audio audio-denoising audio-processing deep-learning deepfilternet deepfilternet2

simplex-micro/riscv-vector-primer

Read chapters directly from this repo - do not use GitHub Pages link.

Category
local and edge ai
Stars
116
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

computer-architecture edge-ai embedded-ai instruction-set-architecture matrix-acceleration open-hardware

Picovoice/pico-cookbook

On-device AI recipes for building private, real-time applications with production-grade voice, language, and vision SDKs. Ready-to-use, open-source code examples.

Category
local and edge ai
Stars
114
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android edge-ai edge-ai-agents ios language-model language-models

swellweb/reame

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures in

Category
local and edge ai
Stars
106
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

arm cpu edge-ai gguf inference kv-cache

ForestHubAI/edge-agents

The 30 MB open-source edge AI agent runtime. Run AI agents offline on Linux (Raspberry Pi, Jetson). GPIO, UART, MQTT as first-class nodes. Industrial protocols (OPC-UA, Modbus) on the roadmap.

Category
local and edge ai
Stars
95
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-runtime ai-agents edge-agents edge-ai edge-computing edge-devices

PeleAB/STM32N6-FaceRecognition

STM32N6 Face Recognition system using AI models deployed on STM32N6570-DK with real-time face detection and recognition capabilities. Complete embedded development environment with automated mode

Category
local and edge ai
Stars
78
Readiness
ready (79/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai face-recognition stm32 stm32n6

FastCrest/tether

FastCrest Tether: the OSS edge-to-cloud AI deploy CLI. Optimize, verify, deploy across Jetson, RTX, Apple Silicon, AMD. Hybrid edge-cloud inference with parity certs.

Category
local and edge ai
Stars
77
Readiness
needs review (56/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility

Strongest signals: fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cli deployment edge-ai edge-cloud fastcrest groot

jaylfc/taosmd

Local-first AI memory — runs offline on any machine with 8 GB+ RAM (SBC, mini PC, laptop, workstation). Zero-loss verbatim archive, knowledge graph, hybrid retrieval. Framework-agnostic, no cloud.

Category
local and edge ai
Stars
72
Readiness
needs review (70/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-memory arm edge-ai embedding framework-agnostic knowledge-graph

eclipse-iofog/Controller

A cloud-native operations Controller for managing edge computing workloads, edgelet nodes, and deployments across Eclipse IoFog.

Category
local and edge ai
Stars
67
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

containers edge-ai edgelet edgeops iofog nats

Aatricks/llmedge

Android native AI inference library, bringing text, image, video, STT, TTS inference

Category
local and edge ai
Stars
63
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android edge-ai gguf huggingface image-generation

alireza787b/PixEagle

Computer vision, object tracking, and target following for PX4 drones using OpenCV, YOLO, MAVSDK, MAVLink, and a real-time web dashboard

Category
local and edge ai
Stars
60
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

autonomous-drones autonomous-systems companion-computer computer-vision drone edge-ai

fkkarakurt/Nerve

Run a real LLM, sentence embeddings and on-device learning in pure C - one header, zero dependencies. TinyLlama-1.1B on a 2017 laptop CPU; the same code as a 65 KB WebAssembly module in your browser.

Category
local and edge ai
Stars
54
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ansi-c artificial-intelligence c c99 edge-ai embedded-systems

microsoft/SPARROW

SPARROW — Solar-Powered Acoustic and Remote Recording Observation Watch. An AI-enabled edge device for biodiversity monitoring with camera-trap imaging and bioacoustic recording. By Microsoft AI for G

Category
local and edge ai
Stars
53
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-for-good audiomoth bioacoustics biodiversity camera-traps conservation

voicute/onnx-wakeword

Offline keyword spotting & wake word engine. ONNX format, model <130KB, inference <10ms. Runs on Android, ESP32, Linux, Web. No cloud, no data usage.

Category
local and edge ai
Stars
51
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android edge-ai esp32 keyword-spotting kws offline

HiveForensics-AI/knolo-core

KnoLo Core is a local-first knowledge base engine built for small language models (LLMs). It packages your documents into a compact .knolo file and enables fully deterministic querying — no embeddings

Category
local and edge ai
Stars
41
Readiness
ready (97/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deterministic-search document-retrieval edge-ai edge-computing knolo knowledge-base

Scottcjn/rpi-inference

RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine for LLMs. Runs on N64, POWER8, x86, ARM.

Category
local and edge ai
Stars
39
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai llm llm-inference mips nintendo-64 power8

DJLougen/hive

Unified agent memory and context compression stack for 2026 NVIDIA + edge (Vera CPU, Grace, Jetson Thor, 3090). Glues busyBee-cpu, honey-comb, and rust-brain. Better effective reasoning per token.

Category
local and edge ai
Stars
35
Readiness
needs review (65/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent busybee context-compression cpu-offload edge-ai grace

evgenii-engineer/openLight

Lightweight AI agent runtime for homelabs, built around deterministic skills and local LLMs.

Category
local and edge ai
Stars
35
Readiness
ready (78/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent edge-ai go golang homelab llm

ultralytics/yolo26

Ultralytics YOLO26 quickstart for detection, instance and semantic segmentation, depth estimation, classification, pose, OBB, and tracking.

Category
local and edge ai
Stars
31
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cli computer-vision deep-learning depth-estimation edge-ai image-classification

pur4v/p2ptokens

Distributed, peer-to-peer, decentralized network for LLM inference — peers seed & leech completions, metered by BitTorrent-protocol-style upload/download ratios. OpenAI-compatible · Rust · libp2p.

Category
local and edge ai
Stars
28
Readiness
ready (73/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-infrastructure bittorrent decentralized decentralized-ai distributed

ID-Robots/clawbox

🦞 ClawBox — Your private AI assistant on NVIDIA Jetson. Setup wizard, dashboard, and 580+ skills. Plug in, scan QR, done.

Category
local and edge ai
Stars
24
Readiness
needs review (70/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-assistant ai-hardware automation edge-ai llm

dp-web4/SAGE

A cognition kernel that wraps a frozen LLM in a persistent identity + trust + governance loop — testing whether capability comes from structure, not weights. Research-stage; honest about what's real v

Category
local and edge ai
Stars
23
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic agents ai ai-governance autonomous cognitive-architecture

mulgadc/spinifex

Spinifex – Open source AWS-compatible platform for secure edge deployments. Run EC2, VPC, S3, and EBS-like services on bare metal with full control. Built for environments where running in the cloud i

Category
local and edge ai
Stars
23
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aws aws-compatible bare-metal baremetal cloud-infrastructure ebs

ultralytics/yolov8

Ultralytics YOLOv8 discovery and quickstart for detection, segmentation, classification, pose, OBB, and tracking.

Category
local and edge ai
Stars
23
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cli computer-vision deep-learning edge-ai image-classification instance-segmentation

mobilint/mblt-model-zoo

Mobilint Model Zoo Project

Category
local and edge ai
Stars
23
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-accelerators computer-vision edge-ai mobilint quantization quantized-neural-networks

Scottcjn/open-xdna

Open-source bring-up + verified matmul on the first-gen AMD XDNA1 (Phoenix/Hawk Point) NPU on Linux — the gen FastFlowLM/Lemonade skip. RyzenAI-npu1, mlir-aie/IRON, XRT.

Category
local and edge ai
Stars
21
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aie2 amd amd-xdna edge-ai fastflowlm-alternative hawk-point

birdnet-team/birdnet-stm32

Code for training and deployment of a tiny acoustic model for the STM32N6

Category
local and edge ai
Stars
20
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

audio bioacoustics birdnet birds classification edge-ai

ruvnet/rvcsi

rvCSI — edge RF sensing runtime: normalize WiFi CSI from Nexmon/ESP32/Intel/Atheros/file/replay into one validated CsiFrame schema, run reusable DSP, emit typed confidence-scored events, bridge to RuV

Category
local and edge ai
Stars
19
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

channel-state-information csi edge-ai esp32 nexmon presence-detection

smshagor-dev/UVA-GPS-Denied-Navigation-in-Dynamic-Environments

GPS-denied autonomous UAV swarm platform with edge AI, distributed swarm intelligence, VIO/EKF fusion, UWB/TDOA localization, secure telemetry, CBOR-based edge communication, and post-quantum security

Category
local and edge ai
Stars
19
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

autonomous-systems cpp cyber-security distributed-systems drone-swarm edge-ai

GG-QandV/mnemostroma

Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL).

Category
local and edge ai
Stars
18
Readiness
ready (72/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents cognitive-architecture edge-ai local-ai memory-management onnx

amanharshx/vision-export-studio

Desktop app to export Ultralytics YOLO & Roboflow RF-DETR models to ONNX, TensorRT, CoreML, TFLite & more — runs 100% locally.

Category
local and edge ai
Stars
18
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

coreml edge-ai object-detection onnx openvino rf-detr

geeks-accelerator/ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

Category
local and edge ai
Stars
17
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-gateway ai-infrastructure ai-router apple-silicon edge-ai embeddings

ultralytics/yolo11

Ultralytics YOLO11 discovery and quickstart for detection, segmentation, classification, pose, OBB, and tracking.

Category
local and edge ai
Stars
16
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cli computer-vision deep-learning edge-ai image-classification instance-segmentation

ori-platform/ori-runtime

An open-source, offline-capable agentic IoT runtime with physical actuation trust. Ori gives physical devices the brain to reason about sensor data via tiered LLM reasoning + graduated authority model

Category
local and edge ai
Stars
16
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-of-things agentic-iot ai-agents aiot edge-ai home-automation

wild-edge/wildedge-python

Python SDK for WildEdge

Category
local and edge ai
Stars
15
Readiness
needs review (65/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-engineering dataset-generation edge-ai edge-ai-agents inference

holland202/principia-artificialis

An open research program exploring the mathematics of artificial thought: information geometry, topology, dynamical systems, and thermodynamics applied to AI inference.

Category
local and edge ai
Stars
15
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

artificial-intelligence deterministic-ai edge-ai embedded-systems machine-learning open-research

cubert-hyperspectral/cuvis-ai

Cuvis.AI is an open-source, extensible framework for building modular AI pipelines that process, analyze, and deploy hyperspectral video data in real-time applications.

Category
local and edge ai
Stars
15
Readiness
ready (78/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai computer-vision data-pipelines edge-ai hyperspectral-imaging machine-

mit-han-lab/once-for-all

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

Category
local and edge ai
Stars
1,954
Readiness
needs review (58/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 967 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

acceleration automl edge-ai efficient-model nas tinyml

sipeed/MaixPy-v1

MicroPython for K210 RISC-V, let's play with edge AI easier

Category
local and edge ai
Stars
1,714
Readiness
needs review (52/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 781 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aiot edge-ai firmware k210 maixpy micropython

DT42/BerryNet

Deep learning gateway on Raspberry Pi and other edge devices

Category
local and edge ai
Stars
1,611
Readiness
needs review (48/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 1268 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aiot deep-learning edge-ai edge-computing edge-devices iot

hailo-ai/hailo_model_zoo

The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment

Category
local and edge ai
Stars
688
Readiness
needs review (70/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-accelerators computer-vision deep-learning edge-ai hailo hailo8

anilsathyan7/Portrait-Segmentation

Real-time portrait segmentation for mobile devices

Category
local and edge ai
Stars
666
Readiness
needs review (59/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 2028 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android color-harmonization coral-tpu deeplab deeplearning deepstream

Azure/AI-in-a-Box

AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. Our intent is to present a curated collection of solution acce

Category
local and edge ai
Stars
596
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
25/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 603 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai azd azd-templates azure chat-bot chatbot

mit-han-lab/tiny-training

On-Device Training Under 256KB Memory [NeurIPS'22]

Category
local and edge ai
Stars
524
Readiness
needs review (51/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: no push in 861 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

edge-ai learning-on-the-edge on-device-training

magic-blue-smoke/Dual-Edge-TPU-Adapter

Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

Category
local and edge ai
Stars
381
Readiness
high risk (36/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 339 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

coral coral-tpu edge-ai edge-tpu edgetpu home-assistant

microsoft/nn-Meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

Category
local and edge ai
Stars
364
Readiness
high risk (0/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
100/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: repository is archived, no push in 738 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deep-learning deep-neural-networks edge-ai edge-computing efficient-model inference

F33RNI/GPT-Telegramus

💜 The best free Telegram bot for ChatGPT, Microsoft Copilot (aka Bing AI / Sidney / EdgeGPT), Microsoft Copilot Designer (aka BingImageCreator), Gemini and Groq with stream writing, requests with imag

Category
local and edge ai
Stars
352
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 813 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai bing bing-image-creator bot chatgpt dalle

facex-engine/facex

Full face stack that runs entirely in the browser. Detection, 576-point 3D mesh, recognition, anti-spoof, smile — all WebAssembly, zero server. Apache 2.0.

Category
local and edge ai
Stars
329
Readiness
needs review (56/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

avx-512 avx2 biometrics c99 computer-vision cpu-inference

bdtinc/maskcam

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.

Category
local and edge ai
Stars
251
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 1904 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

balenaos computer-vision edge-ai jetson-nano mqtt

galliot-us/neuralet

Neuralet is an open-source platform for edge deep learning models on edge TPU, Jetson Nano, and more.

Category
local and edge ai
Stars
243
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 1334 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

coral-tpu deep-learning deep-neural-networks edge-ai edge-computing edge-tpu

FaceOnLive/Spleeter-Android-iOS

On-device, Offline Spleeter Solution For Mobile

Category
local and edge ai
Stars
227
Readiness
needs review (49/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 672 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android audio-processing deep-learning edge-ai ios spleeter

hailo-ai/hailort

An open source light-weight and high performance inference framework for Hailo devices

Category
local and edge ai
Stars
214
Readiness
needs review (60/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deep-learning edge-ai hardware-acceleration machine-learning neural-networks

qualcomm/GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Category
local and edge ai
Stars
8,307
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +18 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gemma4 go gpt-oss granite4 hexagon llama3

thunderbird/thunderbolt

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

Category
local and edge ai
Stars
4,759
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-agents llms on-device-ai

cactus-compute/needle

Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.

Category
local and edge ai
Stars
3,386
Readiness
ready (84/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +59 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cactus gemini gemma llm on-device-ai

nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Category
local and edge ai
Stars
1,044
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai flutter godot godot-engine godot-plugin godot4

SharpAI/SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Category
local and edge ai
Stars
734
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-sili inference ios llm metal mlx

woheller69/whisperIME

Android Input Method Editor (IME) based on Whisper

Category
local and edge ai
Stars
613
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android on-device-ai privacy-protection speech-recognition transcription translation

Samsung/ONE

On-device Neural Engine

Category
local and edge ai
Stars
577
Readiness
needs review (70/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: limited evidence; inspect maintenance signals before adopting

Strongest signals: push recency, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

compiler neural-network on-device-ai optimization runtime

sarim2000/pennywiseai-tracker

PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.

Category
local and edge ai
Stars
536
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android budget-manager budget-tracker expense-tracker finance-management finance-tracker

0xMassi/stik_app

Instant thought capture for macOS. One shortcut, post-it appears, type, close.

Category
local and edge ai
Stars
236
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai keyboard-first local-first mac-app macos markdown

ritesh-kanwar/Cashiro

Cashiro is a comprehensive financial tracking manager that Turn bank SMS and PDF Statements into a clean, searchable money timeline with on-device AI assistance. 100% private, no cloud processing.

Category
local and edge ai
Stars
156
Readiness
needs review (68/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android-app budget-tracker expense-tracker finance-management jetpack-compose kotlin

bitwize-ai/Logue

Privacy-first AI meeting notes & writing assistant for Mac — on-device transcription, smart minutes, action items & 60+ writing modes, running entirely on Apple Silicon

Category
local and edge ai
Stars
141
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon llm macos meeting-notes mlx on-device-ai

pasrom/meeting-transcriber

On-device meeting transcriber for macOS — auto-records Teams/Zoom/Webex, transcribes & separates speakers locally. No cloud. Open-source alternative to Otter/Granola/Fireflies.

Category
local and edge ai
Stars
109
Readiness
ready (98/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-neural-engine coreml fluidaudio local-first macos meeting-notes

ChrisChen667788/pixcull

Local-first AI photo culling for professional photographers — 6-axis rubric, XMP/IPTC export, Lightroom & Capture One ready.

Category
local and edge ai
Stars
105
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai apple-silicon capture-one clip computer-vision image-classification

rayl15/OpenVision

Open-source iOS app connecting Meta Ray-Ban smart glasses to AI — 5 backends (on-device MLX models, Apple Intelligence, OpenAI, Gemini Live, OpenClaw), on-device neural voice, face recognition & live

Category
local and edge ai
Stars
102
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant apple-intelligence face-recognition gemini gemma ios

ShadAdman/EdgeRt

Run ml models with tflite & litert & executorch runtimes on edge devices

Category
local and edge ai
Stars
72
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android-app edge-computing executorch ios-app kotlin litert

zetic-ai/ZETIC_Melange_apps

NPU powered On-device AI Mobile applications using Melange

Category
local and edge ai
Stars
70
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-computing ai-infrastructure aiinfrastructure edge-computing edgeai

saidkaban/expo-ai-kit

On-device AI for Expo apps. Run AI models locally. No API keys, no cloud.

Category
local and edge ai
Stars
68
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai expo kotlin on-device on-device-ai react-native

saurabhav88/EnviousWispr

Free, sub-second on-device AI dictation for macOS. Dual engines (Whisper + Parakeet) on Apple Silicon. Optional AI polish with our own on-device model (EG-1), Apple Intelligence (macOS 26), Ollama, or

Category
local and edge ai
Stars
63
Readiness
needs review (65/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

accessibility apple-silicon coreml dictation macos on-device-ai

john-rocky/apple-silicon-llm-bench

Neutral, reproducible benchmark for local LLMs on Apple Silicon (Mac · iPhone · iPad) — MLX, llama.cpp, CoreML, Apple Foundation Models

Category
local and edge ai
Stars
57
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon benchmark coreml ios llama-cpp llm

hung-yueh/react-native-litert-lm

High-performance on-device LLM inference for React Native, powered by LiteRT-LM and Nitro Modules

Category
local and edge ai
Stars
51
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android expo gemma3n gemma4 ios llm

ThinkOffApp/ClawWatch

The first intelligent AI agent running natively on a smartwatch. NullClaw + Vosk offline STT + Claude on Galaxy Watch

Category
local and edge ai
Stars
49
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent android galaxy-watch kotlin nullclaw offline-ai

joreilly/OnDeviceAI

Extremely minimal Compose Multiplatform sample that demonstrates use of on-device AI on iOS and Android.

Category
local and edge ai
Stars
48
Readiness
ready (74/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android compose-multiplatform foundation-models ios kotlin

rudrankriyam/FoundationModelsAgent

Production harness for Apple Foundation Models on iOS, macOS, and visionOS

Category
local and edge ai
Stars
40
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent agents apple-intelligence foundation-models on-device-ai swift

appautomaton/mlx-speech

Pure-MLX speech synthesis, voice cloning, dialogue, sound-effects, and ASR for Apple Silicon: Fish S2 Pro, VibeVoice, LongCat, MOSS, Step-Audio, Cohere ASR.

Category
local and edge ai
Stars
36
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-mlx apple-silicon asr mlx on-device-ai speech-recognition

john-rocky/coreai-kit

Run LLMs, VLMs, ASR, TTS, diarization and more fully on-device with Apple's Core AI framework (iOS/macOS 27) — one line of Swift per model, 53 models pinned to immutable Hugging Face revisions, each g

Category
local and edge ai
Stars
34
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple asr coreai foundation-models ios llm

noemaai-labs/noema-ios

Production local AI and offline LLM app for iPhone, iPad, Mac, and Apple Vision Pro—available on the App Store with open-source Swift code.

Category
local and edge ai
Stars
33
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant app-store coreml executorch gguf ios

onekapisch/easy-write

Translate & rewrite text anywhere on your Mac — formal or informal — 100% on-device with Apple Intelligence. No accounts, no API keys, no cloud. A free, open-source DeepL / Google Translate alternativ

Category
local and edge ai
Stars
30
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-intelligence deepl-alternative foundation-models german google-translate-alternative language-learning

nicedreamzapp/nicedreamzapp

Building AI tools and learning as I go: mobile computer vision, medical ML, business automation. Started with a chicken problem, ended up doing neuroscience research. Still figuring it out.

Category
local and edge ai
Stars
28
Readiness
ready (81/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai coreml iphone language-translation lidar metal

Tom-Ryder/AgentRunKit

Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon

Category
local and edge ai
Stars
28
Readiness
ready (94/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent-sdk ai-agents anthropic apple-silicon function-calling generative-ai

nicedreamzapp/browser-agent

Local browser agent: MLX + Chrome DevTools Protocol. Handles cross-origin iframes, Shadow DOM, ProseMirror. Runs on Apple Silicon, no cloud.

Category
local and edge ai
Stars
25
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent apple-silicon autonomous-agent browser-automation cdp chrome-devtools-protocol

jmstajim/NanoTeams

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. No cloud, no API keys, no subscription, zero telemetry — your code and your ideas never l

Category
local and edge ai
Stars
24
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai agentic-workflow ai ai-agents coding-agent coding-assistant

stfurkan/bitgpu

Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Bit-exact, zero runtime dependencies.

Category
local and edge ai
Stars
22
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

1-bit browser inference llm on-device-ai quantization

Gunnarguy/OpenIntelligence

Apple-native iOS/macOS app for document intelligence, OCR, cited answers, and source-backed retrieval over PDFs, scans, and user-controlled files.

Category
local and edge ai
Stars
21
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-intelligence citations document-ai document-intelligence document-qa ios

ondeinference/onde

Open-source Llm for Apple silicon devices.

Category
local and edge ai
Stars
21
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

inference-engine llm on-device-ai on-device-inference open-source-models

efeslab/ConsumerBench

A benchmarking framework for on-device AI

Category
local and edge ai
Stars
20
Readiness
ready (78/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

benchmark local-llm on-device-ai

rayl15/Godwit

Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no dependencies.

Category
local and edge ai
Stars
19
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon gpt-oss inference llm local-llm macos

obetomuniz/web-ai-sdk

web-ai-sdk: TypeScript SDK for the Web AI surface (Prompt, Writer, Rewriter, Proofreader, Translator, Summarizer, Language Detector, WebMCP).

Category
local and edge ai
Stars
19
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

browser-ai built-in-ai chrome-ai gemini-nano language-detection language-model

LocalMode-AI/LocalMode

Local-first AI toolkit for the modern web. Build privacy-first AI applications that work entirely in the browser.

Category
local and edge ai
Stars
18
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-sdk embeddings llm local-first nextjs offline-first

RWKV-APP/rwkv_mobile_flutter

Flutter adapter and Dart FFI runtime bridge for on-device inference with rwkv-mobile.

Category
local and edge ai
Stars
18
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

dart ffi flutter local-llm on-device-ai rwkv

MikeSchirtzinger/silent-notetaker

Private, on-device AI meeting notetaker that runs entirely in your browser — live transcription, speaker ID, and note extraction with no audio leaving your machine (WebGPU + WASM).

Category
local and edge ai
Stars
17
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility

Strongest signals: push recency, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

browser-ml local-first meeting-notes on-device-ai privacy speaker-diarization

dsaad68/mispher

Mispher turns speech into clean text anywhere on macOS, then goes further - dictation cleanup, rewrite-in-place, translation, and an on-device agent that plans, uses tools, and answers. No cloud, no a

Category
local and edge ai
Stars
17
Readiness
ready (98/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agent dictation macos mlx mlx-lm on-device-ai

QiuYannnn/Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes

Category
local and edge ai
Stars
3,318
Readiness
needs review (54/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +9 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 655 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

file-organizer llama3 llm on-device-ai vlm

mit-han-lab/proxylessnas

[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Category
local and edge ai
Stars
1,446
Readiness
needs review (59/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 707 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

acceleration automl efficient-model hardware-aware on-device-ai specialization

callstackincubator/ai

On-device LLM execution in React Native with Vercel AI SDK compatibility

Category
local and edge ai
Stars
1,380
Readiness
needs review (67/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai llm on-device-ai react-native

chongzhou96/EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

Category
local and edge ai
Stars
1,168
Readiness
high risk (38/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load. Risks: no push in 440 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

coreml on-device-ai segment-anything

facebookresearch/EdgeTAM

[CVPR 2025] Official PyTorch implementation of "EdgeTAM: On-Device Track Anything Model"

Category
local and edge ai
Stars
960
Readiness
needs review (48/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

on-device-ai sam2 segment-anything

TheStageAI/TheWhisper

Optimized Whisper models for streaming and on-device use

Category
local and edge ai
Stars
895
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon coreml mlx nvidia-gpu on-device-ai real-time

eclaire-labs/eclaire

Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.

Category
local and edge ai
Stars
894
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-assistant automation bookmark-manager bookmarks data-extraction

gkonovalov/android-vad

Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

Category
local and edge ai
Stars
500
Readiness
needs review (59/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 388 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android audio-processing deep-neural-networks dnn gmm neural-networks

Siddhesh2377/ToolNeuron

Encrypted & Privacy First, On Android Device AI App

Category
local and edge ai
Stars
460
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +8 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

encrypted on-device-ai open-source privacy-first

mit-han-lab/amc

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Category
local and edge ai
Stars
450
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: no push in 989 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

automl automl-for-compression channel-pruning efficient-model model-compression on-device-ai

Hugo-Dz/on-device-transcription

A ready-to-use, minimal app that converts any speech into text.

Category
local and edge ai
Stars
386
Readiness
needs review (53/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 763 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-transcription electronjs on-device-ai svelte sveltekit transcription

mutonby/shortcast

Native macOS app: drop a long video → auto-cut viral shorts, captioned for TikTok/Reels/YouTube, reframed to vertical, and scheduled. 100% on-device (Gemma 4 12B + WhisperKit + MLX).

Category
local and edge ai
Stars
361
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon gemma instagram-reels macos mlx on-device-ai

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Category
local and edge ai
Stars
309
Readiness
high risk (44/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 832 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android dart flutter gemini gemini-nano gen-ai

xliucs/MTTS-CAN

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)

Category
local and edge ai
Stars
215
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, fork interest, documentation. Risks: no push in 722 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cardiovascular computer-vision deep-learning healthcare mobile-computing mobilehealth

altic-dev/FluidVoice

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local Wispr Flow alternative. ⭐ helps a ton :) Windows & iOS waitlist open. Linux soon.

Category
local and edge ai
Stars
9,421
Readiness
ready (82/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +224 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai dictation ios llama-cpp macos swift

SciSharp/LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Category
local and edge ai
Stars
3,773
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +15 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatbot gpt llama llama-cpp llama2 llama3

Luce-Org/lucebox

LLM speculative inference server for consumer hardware & heterogeneous computing

Category
local and edge ai
Stars
2,724
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +18 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cuda cuda-kernels dflash heterogeneous-computing kernel llama-cpp

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Category
local and edge ai
Stars
2,150
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai bindings catai cmake cmake-js cuda

QwenAudio/Fun-ASR

Open-source LLM-based ASR model family for Chinese, dialect, accent, and multilingual speech, with FunASR, vLLM, streaming, and llama.cpp runtimes.

Category
local and edge ai
Stars
1,458
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +8 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

31-languages asr audio audio-language-model chinese-dialects fun-asr

ggml-org/Llama-macOS

A cosy home for your LLMs.

Category
local and edge ai
Stars
1,425
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai llama-cpp llms macos swift

mybigday/llama.rn

React Native binding of llama.cpp

Category
local and edge ai
Stars
1,015
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android ios llama llama-cpp llm react-native

FuJacob/cotabby

Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.

Category
local and edge ai
Stars
940
Readiness
needs review (70/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +10 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai autocomplete cotabby cotypist llama llama-cpp

gokayfem/ComfyUI_VLM_nodes

ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, G

Category
local and edge ai
Stars
583
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

comfyui custom-nodes florence-2 gguf grounding-dino image-captioning

AudarAI/Audar-ASR-V1

Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.

Category
local and edge ai
Stars
555
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

arabic arabic-nlp asr audar dialectal-arabic gguf

ciddwd/overlay-translator

无需 ROOT 的开源 Android 屏幕实时翻译工具，适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读（TTS），译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-devic

Category
local and edge ai
Stars
510
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +59 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android android-app game-translation gguf kotlin llama-cpp

lucasjinreal/Crane

A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..

Category
local and edge ai
Stars
448
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
medium
Maintainer health
healthy
Maintenance risk
8/100 · high confidence

Why: +18 stars in 7 days; 100+ commits in 30 days

Why it may be a gem: consistent human and community activity; healthy maintenance and project fundamentals

Strongest signals: push recency, commit activity, issue load. Risks: no pull-request review responses in 30 days. Missing inputs: release recency.

Capped lower bounds: 30-day commits, response activity.

llama-cpp mllm qwen2-vl qwen3 rust spark-tts

avifenesh/memra

memra — from-scratch LLM inference engine for NVIDIA RTX 50-series (Rust + CUDA)

Category
local and edge ai
Stars
297
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai blackwell cuda gemma gguf gpu

gpustack/gguf-parser-go

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

Category
local and edge ai
Stars
285
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gguf go llama-box llama-cpp stable-diffusion-cpp

morganlinton/Albatross

Open source, terminal-first AI coding agent with fully transparent multi-model routing. Local (Ollama, LM Studio, MLX, llama.cpp) or cloud, your keys, one TUI. No black box.

Category
local and edge ai
Stars
220
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-coding-agent ai-coding-assistant cli coding-agent developer-tools harness

hardrave/NIGHTRUN

Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath.

Category
local and edge ai
Stars
201
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +124 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai genai llama-cpp llm ollama runtime

BalanceBalls/nekot

A portable terminal AI interface

Category
local and edge ai
Stars
196
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

chatgpt-api gemini-api go llama-cpp llm ollama

ayushh0110/ScreenMind

AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.

Category
local and edge ai
Stars
196
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai fastapi gemma llama-cpp localai multimodal

Eric-Terminal/ETOS-LLM-Studio

A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and

Category
local and edge ai
Stars
181
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant apple-watch daily-pulse gguf ios llama-cpp

slimeglitch/gryffin-calorai-ventus

Top AI Calorie Tracker GitHub 2026

Category
local and edge ai
Stars
151
Readiness
ready (75/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

claude-code claude-code-skills claude-haiku claude-haiku-4-5 claude-opus claude-sonnet-4-6

tmseidel/ai-git-bot

The self-hosted AI workflow automation platform for Git repositories.

Category
local and edge ai
Stars
135
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +6 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-tools anthropic automation bitbucket bot

VinRobotics/vla.cpp

A unified inference runtime for VLA models.

Category
local and edge ai
Stars
133
Readiness
ready (95/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

deployment gguf llama-cpp quantization robotics vla

Scottcjn/llama-cpp-power8

llama.cpp optimizations for IBM POWER8: vec_perm non-bijunctive collapse, PSE hardware entropy, DCBT prefetch. Sovereign inference. Part of the Proof of Physical AI stack.

Category
local and edge ai
Stars
129
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-inference ibm llama-cpp llm llm-inference power8

aaronnat23/disp8ch

Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or cloud models

Category
local and edge ai
Stars
122
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-ai ai-agents automation llama-cpp llama-server llm

engeldlgado/toshllm

Run large language models locally on Intel Macs with AMD GPUs - native macOS app with Metal acceleration

Category
local and edge ai
Stars
104
Readiness
ready (78/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

amd-gpu hackintosh intel-mac llama-cpp llm local-ai

raiyanyahya/llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Category
local and edge ai
Stars
98
Readiness
needs review (69/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 30 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agents bubbletea cli docker fastapi golang

mattt/llama.swift

A package that provides semantically versioned access to llama.cpp in your Swift projects.

Category
local and edge ai
Stars
80
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

llama-cpp

FedericoTs/quantprobe

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact l

Category
local and edge ai
Stars
72
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +28 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

benchmark gguf hardware-detection inference llama-cpp llm

Scottcjn/llama-cpp-tigerleopard

WORLD FIRST: llama.cpp for Mac OS X Tiger & Leopard on PowerPC G4/G5

Category
local and edge ai
Stars
68
Readiness
ready (90/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

g4 g5 leopard llama-cpp llm llm-inference

ifocus9/PopTrans

PopTrans — Windows 本地离线翻译工具。选中文本 / OCR 截图后一键翻译，基于 Go + Wails + llama.cpp 纯 CPU 推理，无需 GPU。

Category
local and edge ai
Stars
68
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

go hy-mt2 llama-cpp ocr offline rapidocr

Hal0ai/hal0

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

Category
local and edge ai
Stars
63
Readiness
ready (73/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai amd-ryzen-ai fastapi homelab igpu inference

ArkaneFans/servllama

1-Click LLM Server on Your Phone — no Termux needed! 无需Termux，一键让你的手机变成LLM服务器！

Category
local and edge ai
Stars
56
Readiness
ready (85/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

android chatbot flutter llama llama-cpp llama-cpp-ui

cyyself/OpenTihui

on-device LLM for iOS with keyboard shortcuts

Category
local and edge ai
Stars
56
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ios llama-cpp llm-inference

tardellirs/gemma3moe-builder

Sparse-upcycle a dense Gemma-3-270m into a Mixture-of-Experts (gemma3moe) and serve it on llama.cpp (CPU). Upcycle, train, inspect routing, GGUF.

Category
local and edge ai
Stars
56
Readiness
needs review (71/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cpu-inference gemma gemma3 llama-cpp mixture-of-experts moe

thomas9120/LLama-GUI

User friendly GUI for Llama.cpp for easy configuration and launching.

Category
local and edge ai
Stars
54
Readiness
ready (86/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +12 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

gguf gui llama-cpp llamacpp llm llm-inference

off-grid-ai/OGAD

Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.

Category
local and edge ai
Stars
53
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +3 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

electron gguf image-generation llama-cpp llm local-ai

david-g-3654/homebench

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

Category
local and edge ai
Stars
49
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

benchmark cli evaluation llama-cpp llm lm-studio

SouthpawIN/turbofit

Local-first adaptive LLM runtime for Hermes Agent. Matches 8–300 GB hardware, acquires pinned GGUFs through Turbohaul, and safely contracts and heals under VRAM pressure—no remote fallback by default.

Category
local and edge ai
Stars
49
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +5 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

adaptive-runtime benchmarking gguf gpu hermes-agent llama-cpp

VertexCorporation/Cortex

Core of Artificial Intelligence

Category
local and edge ai
Stars
46
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai android artificial-intelligence dart firebase flutter

200lz/llm-inference-optimization-lab

Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.

Category
local and edge ai
Stars
43
Readiness
ready (80/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

continuous-batching kv-cache llama-cpp llm-inference llm-serving prefix-caching

SvReenen/Deskdrop

Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)

Category
local and edge ai
Stars
42
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-keyboard android android-keyboard heliboard keyboard

MADEVAL/FerryAI

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process via FFI. Chat, streaming, embeddings, RAG and vector search. No Python, no HTTP microservi

Category
local and edge ai
Stars
40
Readiness
ready (96/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai embeddings ffi generative-ai gguf inference

countzero/windows_llama.cpp

PowerShell automation to rebuild llama.cpp for a Windows environment.

Category
local and edge ai
Stars
40
Readiness
ready (92/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

cmake conda cuda llama-cpp openblas powershell

tobocop2/lilbee

The whole local AI stack in one executable: it runs and manages local AI models across every GPU, and it's a search engine you can talk to, with cited answers from your files, code, and the web. MCP s

Category
local and edge ai
Stars
40
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-search-engine chat-with-documents gguf llama-cpp lm-studio local-ai

yumiaura/aicommit

AI commit messages from your local LLM - Ollama / llama-cpp backed, offline, Conventional Commits, with review + changelog modes.

Category
local and edge ai
Stars
39
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +4 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai changelog cli code-review conventional-commits developer-tools

Scottcjn/pse-vcipher-collapse

Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES (vcipher) + AltiVec vec_perm. Hebbian path selection, cross-head diffusion, O(1) KV prefiltering.

Category
local and edge ai
Stars
39
Readiness
ready (83/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

aes altivec attention-mechanism cpu-inference deep-learning hardware-acceleration

kekzl/imp

From-scratch C++/CUDA inference engine for the NVIDIA RTX 5090 (sm_120a) — the best single-GPU backend for agentic AI: tool calling, long-context loops, reasoning and concurrent sub-agents on top of t

Category
local and edge ai
Stars
35
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

blackwell cpp cuda fp4 gated-deltanet gguf

RightNow-AI/local-kimi

Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per requ

Category
local and edge ai
Stars
35
Readiness
ready (89/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

anthropic-api claude-code coding-agents int4 kimi llama-cpp

Rahul-14507/MELLM

Lightweight Modular AI Routing Engine for Local LLMs — Run specialised experts efficiently on consumer GPUs using smart Mixture-of-Experts routing.

Category
local and edge ai
Stars
33
Readiness
ready (87/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-router consumer-gpu gguf llama-cpp local-llm mixture-of-experts

SharpAI/DeepCamera

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understand

Category
local and edge ai
Stars
2,974
Readiness
needs review (63/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +11 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-camera ai-nvr camera cctv computer-vision

gotzmann/llama.go

llama.go is like llama.cpp in pure Golang!

Category
local and edge ai
Stars
1,398
Readiness
high risk (43/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 686 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

alpaca chatgpt dalai gpt gpt3 gpt4

docker/compose-for-agents

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.

Category
local and edge ai
Stars
1,018
Readiness
needs review (62/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: +7 stars in 7 days

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic-workflows ai-agents docker docker-compose examples large-language-models

the-crypt-keeper/can-ai-code

Self-evaluating interview for AI coders

Category
local and edge ai
Stars
599
Readiness
needs review (51/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 412 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ggml humaneval langchain llama-cpp llm

mdrokz/rust-llama.cpp

LLama.cpp rust bindings

Category
local and edge ai
Stars
423
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 771 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

api-bindings cpp crates-io ffi llama llama-cpp

dipampaul17/KVSplit

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality lo

Category
local and edge ai
Stars
361
Readiness
high risk (42/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation. Risks: no push in 443 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

apple-silicon generative-ai kv-cache llama-cpp llm m1

jlonge4/local_llama

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

Category
local and edge ai
Stars
295
Readiness
needs review (57/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
risky
Maintenance risk
30/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: no push in 756 days. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

artificial-intelligence langchain llama-cpp llamaindex machinelearning offline

hanxiao/knowledge-graph-extractor

Turn any document or a whole zip into an interactive knowledge graph, using a self-hosted Qwen3.6-35B-A3B-MTP on a single NVIDIA L4

Category
local and edge ai
Stars
213
Readiness
needs review (64/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals; strong signals despite limited visibility

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

fastapi force-graph gpu information-extraction knowledge-graph llama-cpp

lynxai-team/goinfer

Local LLM proxy, DevOps friendly

Category
local and edge ai
Stars
11
Readiness
ready (99/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, fork interest. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

inference inference-api inference-server language-model-api llama-api llama-cpp

phuetz/code-buddy

Open-source multi-provider AI coding agent — terminal + Electron desktop (Cowork) + 24/7 multi-AI fleet, free-first on local Ollama. Opt-in, human-gated evolutionary self-improvement that ingests rese

Category
local and edge ai
Stars
30
Readiness
ready (91/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +1 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

agentic ai-agent ai-coding-assistant autonomous-agents chatgpt claude

maruakshay/miii-cli

Local AI coding agent for your terminal. Open-source, offline alternative to Claude Code, Cursor & Copilot — powered by Ollama and any local LLM. Private by default, free forever.

Category
local and edge ai
Stars
30
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: +2 stars in 7 days

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai ai-coding-assistant ai-pair-programming claude-code-alternative cli code-generation

devoxx/DevoxxGenieIDEAPlugin

DevoxxGenie is an agentic plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code. Latest ver

Category
local and edge ai
Stars
671
Readiness
ready (93/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

anthropic azure-ai chatgpt chatgpt-api claude-3 claude-ai

mrdjohnson/llm-x

LLMX; Easiest 3rd party Local LLM UI for the web!

Category
local and edge ai
Stars
297
Readiness
needs review (55/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
watch
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: healthy maintenance and project fundamentals

Strongest signals: issue load, documentation, license. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-ui automatic1111 automatic1111-ui chat-bot chatbot chatgpt

openensemble/openensemble

Self-hosted multi-user AI assistant with agents, memory, scheduler, ESP32 voice satellites, and a built-in dashboard. Works with Claude, OpenAI, Ollama, LM Studio, and more.

Category
local and edge ai
Stars
6
Readiness
ready (77/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-agent assistant chat-ui claude dashboard home-assistant

nobodywho-ooo/flutter-starter-example

Flutter starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.

Category
local and edge ai
Stars
16
Readiness
ready (77/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai dart flutter inference-engine kokoro-tts llm

nobodywho-ooo/react-native-starter-example

React Native starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.

Category
local and edge ai
Stars
11
Readiness
ready (76/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, issue load, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai inference-engine kokoro-tts llm multimodal-ai on-device-ai

gonicolas12/My_AI

Local-first AI assistant — 9 specialized agents (code, web, debug, security…), 10M-token vector memory, multimodal (vision + local image generation), two-way voice (dictation + read-aloud), slash comm

Category
local and edge ai
Stars
10
Readiness
ready (88/100 heuristic points; not a probability)
Data confidence
low
Maintainer health
healthy
Maintenance risk
0/100 · low confidence

Why: High-signal local and edge ai project

Why it may be a gem: strong signals despite limited visibility; healthy maintenance and project fundamentals

Strongest signals: push recency, fork interest, documentation. Risks: None identified. Missing inputs: commit activity, contributor breadth, release recency, response activity, maintenance distribution.

ai-assistant chatbot chromadb code-generation customtkinter document-processing