remote/sqlite-utils
1
0
Fork 0
mirror of https://github.com/simonw/sqlite-utils.git synced 2026-09-22 08:24:32 +02:00
Code Issues Projects Releases Packages Wiki Activity
1,037 commits 75 branches 140 tags 12 MiB
Commit graph

208 commits

Author SHA1 Message Date
Abhishek Yadav
37caace215 feat: add Database.merge() and sqlite-utils merge command 
Implements the ability to merge tables from one or more source SQLite
databases into a destination database, as requested in #491.

Python API:
    db.merge([src1, src2], alter=True, replace=False, ignore=False, tables=None)
  - source_dbs can be Database objects or file paths
  - Tables not in dest are created; existing tables have rows inserted
  - alter=True adds missing columns to existing destination tables
  - replace=True overwrites rows with matching primary keys
  - ignore=True skips rows with conflicting primary keys
  - tables= limits which tables are merged
  - Virtual tables and their shadow tables are automatically skipped

CLI:
    sqlite-utils merge combined.db one.db two.db [options]
  - Supports --alter, --replace, --ignore, --pk, --table, --load-extension

Closes #491
 2026-03-22 20:49:01 +05:30
Simon Willison
5a7f522980
 		sqlite-utils convert can now use callable references, closes #686 
This now works:

    echo '{"date": "13th January 2025"}' | sqlite-utils insert dates.db dates -
    sqlite-utils convert dates.db dates date r.parsedate
    sqlite-utils rows dates.db dates

Previously the command would have been:

    sqlite-utils convert dates.db dates date 'r.parsedate(value)'
 2025-11-29 14:43:02 -08:00
Simon Willison
35377a874b
 		Detect CSV/TSV column types by default (#683) 
The `--detect-types` option is now automatically turned on for all commands that deal with CSV or CSV.

A new `--no-detect-types` option can be used to have all columns treated as text.

Closes #679
 2025-11-23 22:23:15 -08:00
Simon Willison
0bbc68089c
 		--functions can take filenames, can be used multiple times (#681) 
Closes #659

The --functions option now accepts:
- File paths ending in .py (e.g., --functions my_funcs.py)
- Multiple invocations (e.g., --functions foo.py --functions 'def bar(): ...')
- Inline Python code (existing behavior)

Implementation follows the same pattern as llm's --functions flag
(simonw/llm@a880c123).

Changes:
- Added multiple=True to --functions Click option in query, bulk, and memory commands
- Modified _register_functions() to detect and read .py files
- Updated _maybe_register_functions() to iterate over multiple function sources
- Removed unused bytes/bytearray handling
- Added comprehensive tests for file paths and multiple invocations
- Updated documentation with examples

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* Shorter help for --functions

---------

Co-authored-by: Claude <noreply@anthropic.com>
 2025-11-23 21:46:51 -08:00
Simon Willison
c872d27bb3
 		Use REAL not FLOAT as SQLite column type (#680) 
* Use REAL not FLOAT as SQLite column type, refs #645
* Fix for REAL columns by CSV --detect-types

Refs https://github.com/simonw/sqlite-utils/issues/645#issuecomment-3568947189

* Removed note about strict and REAL
 2025-11-23 21:37:59 -08:00
Simon Willison
fb93452ea8
 		Use double quotes not braces for tables and columns (#678) 
Closes #677
 2025-11-23 20:43:26 -08:00
Simon Willison
96fab69256 Removed convert skip_false and --skip-false, closes #542 2025-11-23 15:40:28 -08:00
Simon Willison
72f6c820f6 Small documentation updates to fix warnings 2025-05-07 17:54:29 -07:00
Simon Willison
88a83f0b7e
 		Link to JSON Lines instead 
ndjson.org has an expired domain.
 2025-05-04 22:50:10 -07:00
Simon Willison
0aefbb634d Removed trogon feature in favor of sqlite-util-tui 
Refs #648, #545
 2025-01-10 17:15:02 -08:00
Gavin Wahl
cbddfb28f9
 		typo in command name (#640) 2024-11-09 08:31:21 -08:00
Gert Goet
4c2628873c
 		Fix typo (#639) 2024-09-03 01:27:16 -07:00
Simon Willison
1feb0c4271 Docs for insert with multiple --pk, refs #621 2024-03-16 17:27:18 -07:00
Simon Willison
23be5be1dc create-table now supports multiple --pk, refs #620 2024-03-16 17:05:39 -07:00
Taj Khattra
1500c19bd0
 		Add more STRICT table support (#604) 
* Add more STRICT table support per https://github.com/simonw/sqlite-utils/issues/344#issuecomment-982014776.
* Make `table.transform()` preserve STRICT mode.
* Fix mypy failures in PR #604
* Link to SQLITE strict page in a few places
 2023-12-07 21:05:27 -08:00
Simon Willison
88bd372205 str, int, bytes aliases for column types, closes #606 2023-12-06 10:49:21 -08:00
Simon Willison
56093de078 sqlite-utils transform --add-foreign-key option, closes #585 2023-08-17 18:51:04 -07:00
Simon Willison
619cea8681 sqlite-utils convert --pdb option, closes #581 2023-07-26 14:06:05 -07:00
Simon Willison
37e374e05a Improved convert() function documentation 2023-07-25 07:47:44 -07:00
Simon Willison
18f190e283 sqlite-utils rename-table command, refs #565 2023-07-22 12:48:04 -07:00
Simon Willison
f7af23837d --empty-null option for CSV and TSV imports, closes #563 2023-07-02 22:42:26 -07:00
Simon Willison
8c739558f7 --stop-after option, closes #561 2023-06-27 11:50:04 -07:00
Simon Willison
8188acc1f1 Fix for missing csv Pygments support, refs #551 2023-05-21 14:03:10 -07:00
Simon Willison
d8fe1b0d89
 		Reformatted CLI examples in docs 
Closes #551
 2023-05-21 13:57:22 -07:00
Simon Willison
718b0cba9b
 		Experimental TUI powered by Trogon 
* sqlite-utils tui command if Trogon is installed, closes #545
* Documentation for trogon TUI
* Screenshot of TUI
* Ignore trogon mypy error
* only run flake8 on Python 3.8 or higher, closes #550
 2023-05-21 11:41:56 -07:00
Simon Willison
d2a7b15b2b
 		Analyze tables options: --common-limit, --no-most, --no-least 
Closes #544
 2023-05-21 09:19:30 -07:00
Simon Willison
e0ec4c3451 --no-skip-false option, plus docs - closes #527 2023-05-08 14:03:20 -07:00
Simon Willison
373b7886d2 --raw-lines option, closes #539 2023-05-07 11:26:14 -07:00
Simon Willison
eb67fc69a2 Run cog -r against latest tabulate, refs #501 2022-10-18 11:08:34 -07:00
Simon Willison
afbd2b2cba Link to convert command too, refs #483 2022-09-26 12:09:32 -07:00
Simon Willison
ee74bd5f81 Fix heading levels, refs #483 2022-09-26 12:03:54 -07:00
Simon Willison
85247038f7 install and uninstall commands, closes #483 2022-09-26 11:57:11 -07:00
Simon Willison
5b969273f1
 		Markup tweak 2022-09-01 18:44:56 -07:00
Simon Willison
087753cd42 sites.db is better name than dogs.db in this example 2022-08-27 21:01:55 -07:00
Simon Willison
104f37fa4d
 		db[table].create(..., transform=True) and create-table --transform 
Closes #467
 2022-08-27 16:17:55 -07:00
Simon Willison
a46a5e3a9e Improved code compilation pattern, closes #472 2022-08-26 22:20:09 -07:00
Simon Willison
31f062d4a7 sqlite-utils query --functions option, refs #471 2022-08-26 21:53:55 -07:00
Simon Willison
7a9a6363ff sqlite-utils rows --order option, closes #469 2022-08-26 21:10:20 -07:00
Simon Willison
f4fb78fa95
 		Cross-link CLI to Python docs (#460) 
* Start cross-linking CLI to Python docs, refs #426
* More links to Python from CLI page, refs #426
 2022-08-18 14:58:07 -07:00
Simon Willison
77ca051d4f
 		Link to installation instructions (#457) 2022-07-27 10:57:50 -07:00
Simon Willison
c710ade644 sqlite-utils duplicate command, closes #454, refs #449 
Also made it so .duplicate() raises new NoTable exception rather than raising
an AssertionError if the source table does not exist.
 2022-07-15 14:45:47 -07:00
Simon Willison
7ddf530088
 		A less potentially confusing parameter name 2022-06-13 08:22:59 -07:00
Yuri
9fedfc69d7
 		docs to dogs (#437) 2022-05-30 14:32:41 -07:00
Simon Willison
397183debd Switch docs theme to Furo, refs #435 2022-05-20 14:52:00 -07:00
Simon Willison
95522ad919 Clarified support for newline-delimited JSON, closes #417 2022-03-25 14:17:10 -07:00
Simon Willison
0b7b80bd40 Document the convert() with initialization pattern, closes #420 2022-03-25 13:07:29 -07:00
Simon Willison
878d5f5cea errors=r.SET_NULL/r.IGNORE options for parsedate/parsedatetime, closes #416 2022-03-20 21:01:35 -07:00
Simon Willison
8f528ed2b1 Fix ReST warning 2022-02-15 17:21:07 -08:00
Simon Willison
3e5a4f60cc Tweaked SpatiaLite CLI docs, refs #398 2022-02-15 17:06:49 -08:00
Chris Amico
a692c56659
 		Add SpatiaLite helpers to CLI (#407) 
* Add SpatiaLite CLI helpers
* Add docs for spaitalite helpers
* Fix flake8 issues and add more detail on spatial types
* Run cog and add some help text.
* Use SpatiaLite when calculating coverage, refs #407

Co-authored-by: Simon Willison <swillison@gmail.com>
 2022-02-15 16:58:07 -08:00