RC RANDOM CHAOS

Datasette plugin adds Apache Arrow streaming export

· via Simon Willison

Original source

datasette-arrows 0.1a0

Simon Willison →

Datasette 1.0a43 introduced plugin support for streaming export formats, enabling CSV and TSV exports without loading full datasets into memory. The register_output_renderer() hook allows plugins to implement similar functionality for other formats. A new plugin, datasette-arrows, implements Apache Arrow streaming based on Claude Fable 5.2’s suggestion. The plugin is installed via ‘datasette install datasette-arrows’ and adds an Arrow export option in the export dialog. The feature is currently available in Datasette’s main branch but not yet grouped with CSV/TSV in the ‘All rows in this table’ section of the latest release.

Read the full article

Continue reading at Simon Willison →

This is an AI-generated summary. Read the original for the full story.