"The highlighted tokens are primarily Vietnamese morphemes, often functioning as prefixes, suffixes, or standalone words that form the core of compound nouns, adjectives, or verbs. These tokens frequently appear in formal, technical, or administrative contexts, and are commonly used in constructing terms related to safety, security, organizations, professions, and abstract concepts. The activations tend to focus on meaningful morphemes that contribute significantly to the semantics of the phrase or sentence."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.76 | 0.964 | 0.54 | 0.692 | 0.54 | 0.98 | 0.02 | 0.46 |
fuzz | 0.78 | 0.912 | 0.62 | 0.738 | 0.62 | 0.94 | 0.06 | 0.38 |