Morpheme Tokenization. Tokenize text into morphemes. The morphemepiece algorithm uses a lookup table to determine the morpheme breakdown of words, and falls back on a modified wordpiece tokenization algorithm for words not found in the lookup table.
[email protected] low health (36/100) — consider alternatives
Get this data programmatically — free, no authentication.
curl https://depscope.dev/api/check/cran/morphemepieceFirst published · 2022-04-16 15:08:35
Last updated · 2022-04-16T13:12:29+00:00