Methods
# inner splitText(text, delimiter) → {String}
Splits a string into an array of substrings based on a specified delimiter.
Parameters:
| Name | Type | Description |
|---|---|---|
text |
String
|
The text to split |
delimiter |
String
|
The delimiter |
- text.split(delimiter)
String
# inner stemText(text) → {String}
Stems a word using the Porter Stemmer algorithm.
Parameters:
| Name | Type | Description |
|---|---|---|
text |
String
|
The text |
- PorterStemmer.stem(text)
String
# inner tokenizeText(text, js_map) → {String}
Tokenizes a string into an array of words or symbols.
Parameters:
| Name | Type | Description |
|---|---|---|
text |
String
|
The text to tokenize |
js_map |
String
|
The javascript Map object |
- Tokenizer.tokenize(text, js_map)
String