Definicja input tokenizer

Co znaczy INPUT TOKENIZER:

A control used to visualize several tokens in an editable field.

Visualiztion of a token depends on its state, which can be any of the following:

Valid Invalid Unchecked

Different tokens are separated by a separator (that is, ";"). One use case is an address bar as used in Microsoft Office. If the user enters a new token in the input tokenizer this token is by definition unchecked and is displayed as normal text. As long as the token has not been verified by the application the user can modify it. After the user has entered all the tokens he/she invokes the validation of the tokens (for example, by clicked on a button that is not part of the control). The application receives the list of tokens and decides which tokens are valid and which are not.