github/datasette
1
0
Fork 0
mirror of https://github.com/simonw/datasette.git synced 2025-12-10 16:51:24 +01:00
Code Issues Projects Releases Packages Wiki Activity
483 commits 143 branches 163 tags 44 MiB
Commit graph

88 commits

Author SHA1 Message Date
Simon Willison
04c896160a
 		Renamed 'stream all records' to 'stream all rows', refs #266 2018-06-18 07:25:44 -07:00
Simon Willison
bb4a9fbf36
 		Docs for CSV export, refs #266 2018-06-18 07:12:21 -07:00
Simon Willison
fc3660cfad
 		Streaming mode for downloading all rows as a CSV (#315) 
* table.csv?_stream=1 to download all rows - refs #266

This option causes Datasette to serve ALL rows in the table, by internally
following the _next= pagination links and serving everything out as a stream.

Also added new config option, allow_csv_stream, which can be used to disable
this feature.

* New config option max_csv_mb limiting size of CSV export
 2018-06-17 20:21:02 -07:00
Simon Willison
ed631e690b
 		?_labels= and ?_label=COL to expand foreign keys in JSON/CSV 
These new querystring arguments can be used to request expanded foreign keys
in both JSON and CSV formats.

?_labels=on turns on expansions for ALL foreign key columns

?_label=COLUMN1&_label=COLUMN2 can be used to pick specific columns to expand

e.g. `Street_Tree_List.json?_label=qSpecies&_label=qLegalStatus`

    {
        "rowid": 233,
        "TreeID": 121240,
        "qLegalStatus": {
            "value" 2,
            "label": "Private"
        }
        "qSpecies": {
            "value": 16,
            "label": "Sycamore"
        }
        "qAddress": "91 Commonwealth Ave",
        ...
    }

The labels option also works for the HTML and CSV views.

HTML defaults to `?_labels=on`, so if you pass `?_labels=off` you can disable
foreign key expansion entirely - or you can use `?_label=COLUMN` to request
just specific columns.

If you expand labels on CSV you get additional columns in the output:

`/Street_Tree_List.csv?_label=qLegalStatus`

    rowid,TreeID,qLegalStatus,qLegalStatus_label...
    1,141565,1,Permitted Site...
    2,232565,2,Undocumented...

I also refactored the existing foreign key expansion code.

Closes #233. Refs #266.
 2018-06-16 15:18:57 -07:00
Simon Willison
b252bdb740
 		Documented how to set multiple --config at once 2018-06-04 18:45:47 -07:00
Simon Willison
29edbe90ff
 		New cache_size_kb config for SQLite, closes #304 2018-06-04 09:02:07 -07:00
Simon Willison
16398641d9
 		SQL syntax highlighting in docs 2018-05-31 06:17:53 -07:00
Simon Willison
d69ebce533
 		Fixed broken :ref: 2018-05-29 20:11:24 -07:00
Simon Willison
27eff1809c
 		Expanded SpatiaLite docs to cover GeoJSON plus lat-lon spatial indexes 2018-05-29 19:32:30 -07:00
Simon Willison
76d11eb768
 		New ?_json=colname argument for returning unescaped JSON 
Also extracted docs for special JSON arguments into a new section.

Closes #31
 2018-05-28 11:08:39 -07:00
Simon Willison
c972d79b5a
 		Added docs on Importing shapefiles into SpatiaLite 2018-05-26 18:39:26 -07:00
Simon Willison
7944a8b0de
 		Added num_sql_threads config option, closes #285 2018-05-26 17:43:22 -07:00
Simon Willison
276913b748
 		?_shape=arrayfirst, closes #287 2018-05-26 17:32:15 -07:00
Simon Willison
b463f60158
 		?_ttl= parameter and default_cache_ttl config 
Refs #285, Closes #289
 2018-05-26 15:17:33 -07:00
Simon Willison
08029a2f8f
 		Hyperlink to www.srihash.org 2018-05-26 12:46:24 -07:00
Simon Willison
df71e8cea8
 		Fixed documentation typo 2018-05-26 11:04:43 -07:00
Simon Willison
37f8361c6f
 		Initial documentation on using SpatiaLite 
https://datasette.readthedocs.io/en/latest/spatialite.html
 2018-05-26 11:04:09 -07:00
Simon Willison
f722b0a730
 		allow_sql config option to disable custom SQL, closes #284 2018-05-24 22:50:50 -07:00
Simon Willison
50920cfe3d
 		allow_facet, allow_download, suggest_facets boolean --config 
Refs #284
 2018-05-24 18:12:27 -07:00
Simon Willison
5d62527882
 		0.22.1 bugfix release 2018-05-23 07:00:01 -07:00
Simon Willison
d59366d36e
 		Link to /-/plugins example 2018-05-20 21:07:26 -07:00
Simon Willison
558d9d7bfe
 		Datasette 0.22: Datasette Facets 2018-05-20 16:41:47 -07:00
Simon Willison
0b8e5981a3
 		Typo fix 2018-05-20 14:30:48 -07:00
Simon Willison
bd3353a31f
 		Added docs for introspection endpoints 
https://datasette.readthedocs.io/en/latest/introspection.html
 2018-05-20 14:28:53 -07:00
Simon Willison
f6183ff5fa
 		Renamed --limit to --config, added --help-config, closes #274 
Removed the --page_size= argument to datasette serve in favour of:

    datasette serve --config default_page_size:50 mydb.db

Added new help section:

    $ datasette --help-config
    Config options:
      default_page_size            Default page size for the table view
                                   (default=100)
      max_returned_rows            Maximum rows that can be returned from a table
                                   or custom query (default=1000)
      sql_time_limit_ms            Time limit for a SQL query in milliseconds
                                   (default=1000)
      default_facet_size           Number of values to return for requested facets
                                   (default=30)
      facet_time_limit_ms          Time limit for calculating a requested facet
                                   (default=200)
      facet_suggest_time_limit_ms  Time limit for calculating a suggested facet
                                   (default=50)
 2018-05-20 10:01:49 -07:00
Simon Willison
2c2e67b9bb
 		Updated default facet limits in docs 2018-05-18 08:50:37 -07:00
Simon Willison
cef9a9a870
 		--limit= mechanism plus new limits for facets 
Replaced the --max_returned_rows and --sql_time_limit_ms options to
"datasette serve" with a new --limit option, which supports a larger
list of limits.

Example usage:

	datasette serve --limit max_returned_rows:1000 \
		--limit sql_time_limit_ms:2500 \
		--limit default_facet_size:50 \
		--limit facet_time_limit_ms:1000 \
		--limit facet_suggest_time_limit_ms:500

New docs: https://datasette.readthedocs.io/en/latest/limits.html

Closes #270
Closes #264
 2018-05-17 22:08:26 -07:00
Simon Willison
5e78d11c24
 		Docs: Speeding up facets with indexes 2018-05-16 21:08:50 -07:00
Simon Willison
96aac7f9e9
 		Facet documentation tweaks 2018-05-16 13:50:34 -07:00
Simon Willison
9959a9e4de Added screenshots to facets and full_text_search docs, refs #255 2018-05-16 08:27:24 -07:00
Simon Willison
858d79fe93 Typo fix 2018-05-16 08:27:24 -07:00
Simon Willison
566f2d31d6 Clarified relationship between metadata and _facet= facets, updated docs - refs @255 2018-05-16 08:27:24 -07:00
Simon Willison
de05cf21aa Facet "selected" key and toggle_url now toggles, refs #255 2018-05-16 08:27:24 -07:00
Simon Willison
eaaa3ea149
 		Initial implementation of facets, plus tests and docs 
Refs #255
 2018-05-12 19:29:41 -03:00
Simon Willison
1c815207cc
 		Update conf.py 2018-05-12 09:08:11 -03:00
Simon Willison
694f845715
 		Documentation for SQLite full-text search support, closes #253 2018-05-12 09:06:38 -03:00
Simon Willison
403211de63
 		Release Datasette 0.21 2018-05-05 20:15:38 -03:00
Simon Willison
1259b8ac0b
 		Support _search_COLUMN=text searches, closes #237 2018-05-05 19:33:08 -03:00
Simon Willison
d4da4c92c8
 		?_size=max option, closes #249 2018-05-04 15:03:40 -03:00
Simon Willison
349e262bb1 Renamed ?_sql_time_limit_ms= to ?_timelimit, closes #242 2018-05-01 17:20:39 -07:00
Simon Willison
a4cc5dc813 New ?_shape=array option + tweaks to _shape, closes #245 
* Default is now ?_shape=arrays (renamed from lists)
* New ?_shape=array returns an array of objects as the root object
* Changed ?_shape=object to return the object as the root
* Updated docs
 2018-05-01 17:20:39 -07:00
Simon Willison
f188ceaa2a
 		New ?_size=XXX querystring parameter for table view, closes #229 
Also added documentation for all of the _special arguments.

Plus deleted some duplicate logic implementing _group_count.
 2018-04-25 21:47:12 -07:00
Simon Willison
02ee31c8b4
 		New hidden: True option for table metadat, closes #239 2018-04-25 20:42:57 -07:00
Simon Willison
f27cabbaf3
 		label_column option in metadata.json - closes #234 2018-04-22 10:53:16 -07:00
Simon Willison
72a7ae6859
 		Datasette 0.20: static assets and templates for plugins 2018-04-20 07:32:02 -07:00
Simon Willison
1e4c295012
 		Fixed out-dated template in documentation 2018-04-18 22:57:31 -07:00
Simon Willison
b52171db1e
 		Plugins can now bundle custom templates, closes #224 
Refs #14
 2018-04-18 22:50:27 -07:00
Simon Willison
6e28ed447f
 		Thanks to #214 JavaScript is no longer 'soon' 2018-04-18 08:17:20 -07:00
Simon Willison
7581320823
 		Documentation for --install option, refs #223 2018-04-18 08:05:06 -07:00
Simon Willison
f8f818711b
 		Formatting tweak 2018-04-17 21:30:58 -07:00