Datasette plugin adds Apache Arrow streaming export
· via Simon Willison
Datasette 1.0a43 introduced plugin support for streaming export formats, enabling CSV and TSV exports without loading full datasets into memory. The register_output_renderer() hook allows plugins to implement similar functionality for other formats. A new plugin, datasette-arrows, implements Apache Arrow streaming based on Claude Fable 5.2’s suggestion. The plugin is installed via ‘datasette install datasette-arrows’ and adds an Arrow export option in the export dialog. The feature is currently available in Datasette’s main branch but not yet grouped with CSV/TSV in the ‘All rows in this table’ section of the latest release.
Read the full article
Continue reading at Simon Willison →This is an AI-generated summary. Read the original for the full story.