github/datasette
1
0
Fork 0
mirror of https://github.com/simonw/datasette.git synced 2025-12-10 16:51:24 +01:00
Code Issues Projects Releases Packages Wiki Activity
536 commits 143 branches 163 tags 44 MiB
Commit graph

108 commits

Author SHA1 Message Date
Simon Willison
788a542d3c
 		Docs for IndexView, TableView, RowView, closes #299 
Also removed xfail from test_view_classes_are_documented, so any future *View
classes that are added without documentation will cause the tests to fail.
 2018-07-27 21:21:42 -07:00
Simon Willison
8da6b0d542
 		Added labels so unit tests can detect docs, refs #299 2018-07-27 20:26:18 -07:00
Simon Willison
dbbe707841
 		publish_subcommand hook + default plugins mechanism, used for publish heroku/now (#349) 
This change introduces a new plugin hook, publish_subcommand, which can be
used to implement new subcommands for the "datasette publish" command family.

I've used this new hook to refactor out the "publish now" and "publish heroku"
implementations into separate modules. I've also added unit tests for these
two publishers, mocking the subprocess.call and subprocess.check_output
functions.

As part of this, I introduced a mechanism for loading default plugins. These
are defined in the new "default_plugins" list inside datasette/app.py

Closes #217 (Plugin support for datasette publish)
Closes #348 (Unit tests for "datasette publish")
Refs #14, #59, #102, #103, #146, #236, #347
 2018-07-25 22:15:59 -07:00
Simon Willison
bd1db56936
 		'Usage: datasette', not 'Usage: cli' - refs #336 2018-07-24 09:03:07 -07:00
Simon Willison
74ad3ff4af
 		Ensure --help examples in docs are always up to date, closes #336 
Unit tests now check that docs/*.txt help examples are all up-to-date.

I ran into a problem here in that the terminal_width needed to be more
accurately defined - so I replaced update-docs-help.sh with update-docs-
help.py which hard-codes the terminal width.
 2018-07-24 09:01:23 -07:00
Simon Willison
28872a1fa7
 		Release notes for 0.24 release 2018-07-23 21:34:38 -07:00
Simon Willison
700d83d8ad
 		?_json_infinity=1 for handling Infinity/-Infinity - fixes #332 2018-07-23 20:07:57 -07:00
Simon Willison
f24b49a1a8
 		New force_https_urls option, refs #333 2018-07-23 08:58:29 -07:00
Simon Willison
6e37f091ed
 		Support title/description for canned queries, closes #342 
Demo here: https://latest.datasette.io/fixtures/neighborhood_search
 2018-07-15 19:33:30 -07:00
Russ Garrett
58fec99ab0 Allow app names for datasette publish heroku 
Lets you supply the `-n` parameter for Heroku deploys, which also lets
you update existing Heroku deployments.
 2018-07-14 07:04:42 -07:00
Simon Willison
aec3ae5323
 		Docs for datasette publish and package, closes #337 
Also introduced a new mechanism for ensuring the --help examples in the
documentation reflect the current output of the --help commands, via a new
update-docs-help.sh script. Closes #336
 2018-07-10 19:05:46 -07:00
Simon Willison
9281a4a804
 		New tagline: 'A tool for exploring and publishing data' 2018-07-10 19:05:41 -07:00
Simon Willison
fc9b1cc136
 		New truncate_cells_html config for truncating cells, closes #330 2018-07-10 09:20:41 -07:00
Simon Willison
6df6f712b3
 		Release notes for 0.23.2 2018-07-07 22:28:45 -07:00
Simon Willison
29bd606514
 		Documentation typo 2018-06-28 00:09:03 -05:00
Simon Willison
7d9bcdd307
 		Documentation tweaks 2018-06-28 00:07:53 -05:00
Simon Willison
ad66c0da2b
 		Installation instructions, including docker image - closes #328 2018-06-27 22:59:58 -05:00
Simon Willison
dea86b9fba
 		Changelog for 0.23.1 2018-06-21 08:37:13 -07:00
Simon Willison
3683a6b626
 		Docs + example of canned SQL query using || concatenation 
Closes #321
 2018-06-20 21:54:36 -07:00
Simon Willison
e04f5b0d34
 		Release notes for 0.23 2018-06-18 08:11:57 -07:00
Simon Willison
04c896160a
 		Renamed 'stream all records' to 'stream all rows', refs #266 2018-06-18 07:25:44 -07:00
Simon Willison
bb4a9fbf36
 		Docs for CSV export, refs #266 2018-06-18 07:12:21 -07:00
Simon Willison
fc3660cfad
 		Streaming mode for downloading all rows as a CSV (#315) 
* table.csv?_stream=1 to download all rows - refs #266

This option causes Datasette to serve ALL rows in the table, by internally
following the _next= pagination links and serving everything out as a stream.

Also added new config option, allow_csv_stream, which can be used to disable
this feature.

* New config option max_csv_mb limiting size of CSV export
 2018-06-17 20:21:02 -07:00
Simon Willison
ed631e690b
 		?_labels= and ?_label=COL to expand foreign keys in JSON/CSV 
These new querystring arguments can be used to request expanded foreign keys
in both JSON and CSV formats.

?_labels=on turns on expansions for ALL foreign key columns

?_label=COLUMN1&_label=COLUMN2 can be used to pick specific columns to expand

e.g. `Street_Tree_List.json?_label=qSpecies&_label=qLegalStatus`

    {
        "rowid": 233,
        "TreeID": 121240,
        "qLegalStatus": {
            "value" 2,
            "label": "Private"
        }
        "qSpecies": {
            "value": 16,
            "label": "Sycamore"
        }
        "qAddress": "91 Commonwealth Ave",
        ...
    }

The labels option also works for the HTML and CSV views.

HTML defaults to `?_labels=on`, so if you pass `?_labels=off` you can disable
foreign key expansion entirely - or you can use `?_label=COLUMN` to request
just specific columns.

If you expand labels on CSV you get additional columns in the output:

`/Street_Tree_List.csv?_label=qLegalStatus`

    rowid,TreeID,qLegalStatus,qLegalStatus_label...
    1,141565,1,Permitted Site...
    2,232565,2,Undocumented...

I also refactored the existing foreign key expansion code.

Closes #233. Refs #266.
 2018-06-16 15:18:57 -07:00
Simon Willison
b252bdb740
 		Documented how to set multiple --config at once 2018-06-04 18:45:47 -07:00
Simon Willison
29edbe90ff
 		New cache_size_kb config for SQLite, closes #304 2018-06-04 09:02:07 -07:00
Simon Willison
16398641d9
 		SQL syntax highlighting in docs 2018-05-31 06:17:53 -07:00
Simon Willison
d69ebce533
 		Fixed broken :ref: 2018-05-29 20:11:24 -07:00
Simon Willison
27eff1809c
 		Expanded SpatiaLite docs to cover GeoJSON plus lat-lon spatial indexes 2018-05-29 19:32:30 -07:00
Simon Willison
76d11eb768
 		New ?_json=colname argument for returning unescaped JSON 
Also extracted docs for special JSON arguments into a new section.

Closes #31
 2018-05-28 11:08:39 -07:00
Simon Willison
c972d79b5a
 		Added docs on Importing shapefiles into SpatiaLite 2018-05-26 18:39:26 -07:00
Simon Willison
7944a8b0de
 		Added num_sql_threads config option, closes #285 2018-05-26 17:43:22 -07:00
Simon Willison
276913b748
 		?_shape=arrayfirst, closes #287 2018-05-26 17:32:15 -07:00
Simon Willison
b463f60158
 		?_ttl= parameter and default_cache_ttl config 
Refs #285, Closes #289
 2018-05-26 15:17:33 -07:00
Simon Willison
08029a2f8f
 		Hyperlink to www.srihash.org 2018-05-26 12:46:24 -07:00
Simon Willison
df71e8cea8
 		Fixed documentation typo 2018-05-26 11:04:43 -07:00
Simon Willison
37f8361c6f
 		Initial documentation on using SpatiaLite 
https://datasette.readthedocs.io/en/latest/spatialite.html
 2018-05-26 11:04:09 -07:00
Simon Willison
f722b0a730
 		allow_sql config option to disable custom SQL, closes #284 2018-05-24 22:50:50 -07:00
Simon Willison
50920cfe3d
 		allow_facet, allow_download, suggest_facets boolean --config 
Refs #284
 2018-05-24 18:12:27 -07:00
Simon Willison
5d62527882
 		0.22.1 bugfix release 2018-05-23 07:00:01 -07:00
Simon Willison
d59366d36e
 		Link to /-/plugins example 2018-05-20 21:07:26 -07:00
Simon Willison
558d9d7bfe
 		Datasette 0.22: Datasette Facets 2018-05-20 16:41:47 -07:00
Simon Willison
0b8e5981a3
 		Typo fix 2018-05-20 14:30:48 -07:00
Simon Willison
bd3353a31f
 		Added docs for introspection endpoints 
https://datasette.readthedocs.io/en/latest/introspection.html
 2018-05-20 14:28:53 -07:00
Simon Willison
f6183ff5fa
 		Renamed --limit to --config, added --help-config, closes #274 
Removed the --page_size= argument to datasette serve in favour of:

    datasette serve --config default_page_size:50 mydb.db

Added new help section:

    $ datasette --help-config
    Config options:
      default_page_size            Default page size for the table view
                                   (default=100)
      max_returned_rows            Maximum rows that can be returned from a table
                                   or custom query (default=1000)
      sql_time_limit_ms            Time limit for a SQL query in milliseconds
                                   (default=1000)
      default_facet_size           Number of values to return for requested facets
                                   (default=30)
      facet_time_limit_ms          Time limit for calculating a requested facet
                                   (default=200)
      facet_suggest_time_limit_ms  Time limit for calculating a suggested facet
                                   (default=50)
 2018-05-20 10:01:49 -07:00
Simon Willison
2c2e67b9bb
 		Updated default facet limits in docs 2018-05-18 08:50:37 -07:00
Simon Willison
cef9a9a870
 		--limit= mechanism plus new limits for facets 
Replaced the --max_returned_rows and --sql_time_limit_ms options to
"datasette serve" with a new --limit option, which supports a larger
list of limits.

Example usage:

	datasette serve --limit max_returned_rows:1000 \
		--limit sql_time_limit_ms:2500 \
		--limit default_facet_size:50 \
		--limit facet_time_limit_ms:1000 \
		--limit facet_suggest_time_limit_ms:500

New docs: https://datasette.readthedocs.io/en/latest/limits.html

Closes #270
Closes #264
 2018-05-17 22:08:26 -07:00
Simon Willison
5e78d11c24
 		Docs: Speeding up facets with indexes 2018-05-16 21:08:50 -07:00
Simon Willison
96aac7f9e9
 		Facet documentation tweaks 2018-05-16 13:50:34 -07:00
Simon Willison
9959a9e4de Added screenshots to facets and full_text_search docs, refs #255 2018-05-16 08:27:24 -07:00