Commit graph

11 commits

Author SHA1 Message Date
Parker Gurney
f6d83ec8be insert-files: add --convert/--import to transform rows during import
Reuses the same _compile_code mechanism as insert/upsert --convert and the
convert command (row variable, r. recipes, --import for extra modules)
instead of a bespoke mini-language. Lets sqlar-style imports (or any other
per-row transform) happen in one insert-files call rather than needing a
separate convert pass afterwards.

Closes #597
2026-08-05 14:15:20 -07:00
Parker Gurney
daf2ebbbaf insert-files: add --sqlar flag and content_sqlar column for sqlar-compatible compressed payloads
Adds a --sqlar option that defaults insert-files to the name/mode/mtime/sz/data
schema used by SQLite's own sqlar archive format, plus a content_sqlar column
type that zlib-compresses content the same way sqlar_compress() does (only
when compression actually shrinks the data). Reuses the existing -c coldef
parsing added for fixed-literal metadata columns, no changes needed there.
Existing BLOB/TEXT content/content_text imports are untouched.

Closes #141
2026-08-05 14:11:43 -07:00
Parker Gurney
71664b8fcf insert-files: support fixed value columns via -c colname:text:value
Extends the -c/--column spec so a column can be populated with a
literal value for every inserted file, e.g. -c file_type:text:gif,
without a separate update pass. Existing colname:coldef shorthands
and compound --pk behavior are unchanged.

Closes #140
2026-08-05 14:06:58 -07:00
Simon Willison
69a1c0d960
Fixes for Ruff>=0.16.0 (#814)
* Automated upgrades by Ruff

    uvx --with 'ruff>=0.16.0' ruff check . --fix --unsafe-fixes

* Fix remaining Ruff errors with GPT-5.6 Sol high

https://gist.github.com/simonw/6da7906a9fea6e90da131c21a9055199

* Fix flake E501 long lines
* New Protocol for migrations to make ty happy
2026-07-25 14:53:12 -07:00
Simon Willison
1d050dcdc7 insert-files multiple --pk support, closes #621 2024-03-16 17:33:31 -07:00
Simon Willison
c9ecd0d6a3 stem and suffix columns for insert-files, closes #372 2022-01-09 12:16:52 -08:00
Simon Willison
49a010c93d
Ability to insert file contents as text, in addition to blob (#321) 2021-08-24 16:31:13 -07:00
Simon Willison
60dea99ef7 --silent option for sqlite-utils insert-files, closes #301 2021-08-02 12:12:16 -07:00
Simon Willison
f51a1f6c3c
Run tests against Ubuntu, macOS and Windows
With tests fixes for Windows, thanks to @nieuwenhoven in #225. Closes #232
2021-02-14 12:39:54 -08:00
Simon Willison
8fe1e6d1be insert-files can now read from stdin, closes #127 2020-07-29 20:08:12 -07:00
Simon Willison
ebc802f7ff sqlite-utils insert-files command, closes #122 2020-07-27 00:08:57 -07:00