remote/sqlite-utils
1
0
Fork 0
mirror of https://github.com/simonw/sqlite-utils.git synced 2026-09-27 04:14:30 +02:00
Code Issues Projects Releases Packages Wiki Activity

Add implementation to read --parquet files.

Browse source
This commit is contained in:
Florents Tselai 2021-10-29 02:34:37 +03:00
commit 50ec2e49de
5 changed files with 79 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

11
docs/cli.rst
View file

@ -665,6 +665,17 @@ The ``most_common`` and ``least_common`` columns will contain nested JSON arrays
.. _cli_inserting_data:
Inserting Parquet data
======================
Parquet is a columnar storage format, frequently used in the Hadoop/Spark ecosystem as well as cloud providers.
Parquet files can be inserted via the ``--parquet`` flag.
Here's an example::
$ sqlite-utils insert --parquet data.db data ./data.parquet
Parquet files, along with the data store data types too, thus making the ``--detect-types`` flag redundant, as data types are inferred automatically (using PyArrow)
Inserting JSON data
===================