hiw3c 日报精选
Simon Willison 网页快照

数据集箭头 0.1a0

原文标题 · datasette-arrows 0.1a0

发布:datasette-arrows 0.1a0,Datasette 1.0a43 新增了插件实现流式导出格式的功能。Datasette 核心支持流式 CSV 和 TSV 格式——您可以从表格中导出数百万行数据,无需将所有数据加载至内存中,因为这两种文件格式支持按块流式传输数据。现在,register_output_renderer() 插件钩子可用于为其他格式实现相同模式。我认识到,在未配套使

来源:Simon Willison · simonwillison.net

正文为英文,可一键机器翻译(仅首次需要等待)

Simon Willison’s Weblog

Datasette 1.0a43 added the ability for plugins to implement streaming export formats. Datasette core supports streaming CSV and TSV - you can export millions of lines of data from a table without needing to load it all into memory, because those two file formats support streaming data in chunks. The register_output_renderer() plugin hook can now be used to implement the same pattern for other formats.

I've learned never to release a new plugin feature without accompanying it with a plugin that uses it.

Claude Fable 5.2 suggested the Apache Arrow streaming format as a good option, and built this plugin in almost a single shot.

Add the plugin to Datasette ( datasette install datasette-arrows ) and the export dialog gains this new Arrow option:

This screenshot is from Datasette's main branch - the most recent release doesn't yet group streaming formats such as Arrow with the TSV and CSV in the "All rows in this table" section, but that's coming in the next alpha release.

Recent articles

Running the full server-side Datasette Python app in the browser with service workers and Pyodide - 17th November 2026

Locating the source of a mysterious beep with Claude - 9th November 2026

Hide your slop PR descriptions behind <details><summary> - 9th November 2026

Qwen 3.8 27B on my laptop can interpret model weights, too - 3rd November 2026

This is a beat by Simon Willison, posted on 18th November 2026 .

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.