Moodle PHP Documentation 4.2
Moodle 4.2.8 (Build: 20240610) (2d41ac46f45)
|
Public Member Functions | |
tokenize (string $text) | |
Phpml\Tokenization\WordTokenizer::tokenize | ( | string | $text | ) |
Implements Phpml\Tokenization\Tokenizer.
Reimplemented in Phpml\Tokenization\NGramTokenizer, and Phpml\Tokenization\NGramWordTokenizer.