Moodle PHP Documentation 4.5
Moodle 4.5dev (Build: 20240606) (d3ae1391abe)
|
Public Member Functions | |
tokenize (string $text) | |
Phpml\Tokenization\WordTokenizer::tokenize | ( | string | $text | ) |
Implements Phpml\Tokenization\Tokenizer.
Reimplemented in Phpml\Tokenization\NGramTokenizer, and Phpml\Tokenization\NGramWordTokenizer.