Edge-ai is a topic tracked in our intelligence system with 5 linked articles.
PrismML unveils Bonsai Image 4B, two ultra-compact on-device diffusion models (1-bit and ternary) with footprints under 2 GB, enabling local image generation on iPhone and other devices with open weights under Apache 2.0.
A research paper demonstrates Rotary GPU enabling local execution of large Mixture-of-Experts models on consumer hardware (8 GB VRAM), achieving 2048 tokens at ~6.3 GB VRAM and ~21 tokens/sec, signaling edge-deployment viability under VRAM constraints.
Liquid AI unveils LFM2.5-8B-A1B, an 8B parameter MoE edge model with 128K context, 38T pretraining, expanded tokenizer, and strong on-device benchmarking and tool-calling capabilities.
Rivian’s software chief outlines the VW-Rivian RV Tech JV as a platform to power VW Group EVs with a shared OS and fewer ECUs, notes about 1,500 staff, the R2 and ID.1 lineup, Rivian Assistant, and a stance that CarPlay may become obsolete amid AI-enabled in-car interfaces and regulatory safety constraints.
Espressif unveils ESP32-S31, a dual-core RV32IMAFCP+CLIC SoC with Wi-Fi 6, Bluetooth 5.4, 1 Gbps Ethernet, 512 KB SRAM, and rich HMI/media capabilities for edge IoT.
A headline claims the iPhone 17 Pro can run a 400B-parameter LLM, implying on-device inference of large models is possible.
Subscribe for real-time topic updates and unlimited access to our intelligence platform.