About Recognized Tokens
A recognized token is a short piece of text that a translation memory (TM) treats as a single word. A recognized token is always contained within a segment. For example, if dates are enabled as a recognized token in a TM, the TM recognizes Monday 1 January, 1900 as one word.
For most recognized tokens, the TM automatically produces the translation, and in such cases, it can also automatically localize the translation. Tokens that can be recognized in WorldServer are:
- Dates
- Times
- Numbers (in numerals)
- Measurements
- Acronyms and URLs (translation target is the same as the source)