"The highlighted tokens are morphemes, word roots, or affixes in multiple languages, often marking grammatical features such as tense, case, gender, or plurality, or forming part of proper nouns and place names. These tokens frequently appear at word boundaries or within compound words, reflecting their importance in word formation and meaning across diverse linguistic contexts."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.56 | 0.544 | 0.74 | 0.627 | 0.74 | 0.38 | 0.62 | 0.26 |
fuzz | 0.53 | 0.516 | 0.96 | 0.671 | 0.96 | 0.1 | 0.9 | 0.04 |