"The highlighted tokens are primarily morphemes, syllables, or short word fragments in Thai and English, often marking key semantic units such as nouns, verbs, locations, or grammatical particles. These segments frequently appear at the boundaries of words or phrases, and are important for identifying meaning, structure, or named entities within multilingual or code-mixed text."
| Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
|---|---|---|---|---|---|---|---|---|
| detection | 0.7 | 0.794 | 0.54 | 0.643 | 0.54 | 0.86 | 0.14 | 0.46 |
| fuzz | 0.54 | 0.53 | 0.7 | 0.603 | 0.7 | 0.38 | 0.62 | 0.3 |