Apple Unifies LLM Access With Foundation Models Framework

Apple unveiled the Foundation Models framework, a native Swift API for integrating large language models into applications. The framework provides unified access to Apple’s on-device foundation models via Private Cloud Compute alongside third-party models like Claude and Gemini. Multimodal capabilities enable apps to process images with text, with direct Vision framework integration for OCR and barcode scanning. Tool calling and guided generation are built-in features.

Dynamic Profiles let developers adjust a model’s parameters, reasoning level, and toolset during a session while preserving context history. An Evaluations framework validates prompt behavior across configurations before deployment. Members of Apple’s App Store Small Business Program get free access to Apple’s foundation models on Private Cloud Compute, eliminating cloud API costs while guaranteeing user data privacy—information is neither stored nor accessible to Apple.

The framework extends to developer tooling including a command-line utility for macOS 27, a Python SDK, and experimental utilities for building AI agents and managing context. Third-party model providers can create Swift packages conforming to the Language Model protocol, enabling additional models to integrate with the framework.