Skip to content
#

litertlm

Star

Here are 5 public repositories matching this topic...

ventouxlabs / relais

Star 1

Headless on-device LLM node for Android — runs a model on your phone's GPU via Google's LiteRT-LM and serves an OpenAI-compatible API (chat, embeddings, RAG, image-gen, TTS) over your LAN. Fork of Google's AI Edge Gallery, rebuilt as infrastructure you operate, not an app you open. AGPL-3.0.

android kotlin privacy lan self-hosted inference-server gemma edge-ai on-device-ai local-first mobile-ai openai-api llm offline-ai litertlm
  • Updated Sep 22, 2026
  • Kotlin

priyanshuchawda / gemma_control

Star 0

GemmaControl — A private, on-device Android AI agent for WhatsApp productivity. Captures and organises WhatsApp notifications into an actionable inbox, leverages Google's FunctionGemma 270M (via LiteRT-LM) to propose tool calls, and enables safe user-confirmed replies — all running fully offline with AES-GCM 256-bit encrypted local storage.

android kotlin productivity privacy mvvm whatsapp aes-gcm gemma android-keystore room-database notification-listener workmanager edge-ai jetpack-compose on-device-ai ai-agent llm function-calling android-16 litertlm
  • Updated Jun 11, 2026
  • Kotlin

Add this topic to your repo

To associate your repository with the litertlm topic, visit your repo's landing page and select "manage topics."

Learn more