Skip to content

Fix the --tokenize example in the CLI docs - #904

Open
Ronak-Mahidharia wants to merge 1 commit into
simonw:mainfrom
Ronak-Mahidharia:docs-tokenize-enable-fts
Open

Ronak-Mahidharia wants to merge 1 commit into
simonw:mainfrom
Ronak-Mahidharia:docs-tokenize-enable-fts

Conversation

@Ronak-Mahidharia

@Ronak-Mahidharia Ronak-Mahidharia commented Oct 12, 2026 •

Copy link
Copy Markdown

The example for a custom FTS tokenizer in docs/cli.rst uses populate-fts:

sqlite-utils populate-fts mydb.db documents title summary --tokenize=porter

populate-fts has no --tokenize option, so with sqlite-utils 4.2.1 it fails with Error: No such option '--tokenize'. The option belongs to enable-fts, which this part of the page describes. With enable-fts the same command works, and a search for run then matches "Running", so the Porter stemming takes effect.


📚 Documentation preview 📚: https://sqlite-utils--904.org.readthedocs.build/en/904/

--tokenize is an option of enable-fts, which the paragraph describes. populate-fts has no such option, so the example failed with "No such option '--tokenize'."
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant