edge inference
2 posts
Article
Most automation doesn't need a smart model
Cactus Needle 3 is an 8-29 MB offline model for tool calls, extraction and embeddings, with triggers and confidence gating you have to wire carefully.
Article
Desert Ant Labs puts inference inside the loop
Desert Ant Labs launched 18 on-device AI models it says beat cloud APIs on speed, cost and size, running free on phones up to 100k devices.