tokenizeWords
tokenizeWords(
sentence):string[]
Defined in: tokenizer.ts:195
Tokenize into plain word-strings (the form the parser consumes).
Parameters
Section titled “Parameters”sentence
Section titled “sentence”string
Returns
Section titled “Returns”string[]