text2ngrams¶
Description¶
Usage: textkit text2ngrams [OPTIONS] [TEXT]...
Tokenize plain text into ngrams. ngrams are n-length word tokens.
Punctuation is considered as a separate token.
Options:
-s, --sep TEXT Separator between words in bigram output. [default: ]
-n, --num INTEGER Length of the n-gram [default: 2]
--help Show this message and exit.
