Datasette-llm adds OpenAI-compatible LLM support
· via Simon Willison
Datasette-llm, a plugin that integrates language models with the Datasette data exploration tool, now supports OpenAI-compatible endpoints. This lets developers point Datasette at any LLM service implementing the OpenAI protocol, breaking dependency on OpenAI’s own models.
The practical upside is immediate: developers can wire up locally-hosted models from tools like LM Studio, Ollama, or llama.cpp. The release includes a concrete example of spinning up a Datasette Agent instance powered by a local Qwen model via a single uvx command, with the LLM endpoint configured through plugin settings.
Read the full article
Continue reading at Simon Willison →This is an AI-generated summary. Read the original for the full story.