remote/sqlite-utils
1
0
Fork 0
mirror of https://github.com/simonw/sqlite-utils.git synced 2026-07-23 01:14:31 +02:00
Code Issues Projects Releases Packages Wiki Activity

Increase csv field_size_limit to maximum, closes #229

Browse source 
Refs #227
This commit is contained in:
Simon Willison 2021-02-14 13:33:21 -08:00
commit 1a93b72ba7
2 changed files with 32 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

12
sqlite_utils/cli.py
View file

@ -31,6 +31,18 @@ It's often worth trying: --encoding=latin-1
""".strip()
# Increase CSV field size limit to maximim possible
# https://stackoverflow.com/a/15063941
field_size_limit = sys.maxsize
while True:
try:
csv_std.field_size_limit(field_size_limit)
break
except OverflowError:
field_size_limit = int(field_size_limit / 10)
def output_options(fn):
for decorator in reversed(
(