On-device is a topic tracked in our intelligence system with 5 linked articles.
Liquid AI unveils LFM2.5-8B-A1B, an 8B parameter MoE edge model with 128K context, 38T pretraining, expanded tokenizer, and strong on-device benchmarking and tool-calling capabilities.
A practical guide to running local LLMs on a 24GB MacBook Pro using LM Studio, Pi, and OpenCode, with concrete models, context sizes, and config tweaks illustrating hardware-bound tradeoffs and workflow implications for developers.
Recall is an open-source, local multimodal memory search that stores vectors on-device using Gemini Embedding 2 and ChromaDB, with a setup wizard and Raycast UI, and optional Google embedding API calls.
Three new Kitten TTS models released, with the smallest under 25MB.
Claim/rumor of 'Microsoft BitNet', a 100B-parameter 1-bit model intended for local CPU deployment.
Sopro TTS is a 169M-parameter TTS model with zero-shot voice cloning that runs on CPU, signaling a compact on-device solution.
Subscribe for real-time topic updates and unlimited access to our intelligence platform.