Token Class

Definition

Represents an individual token, such as a word in an input string.

public class Token
type Token = class
Public Class Token
Inheritance
Token

Constructors

Token()

Properties

End

Gets or sets the index of the last character of the token within the input.

Normalized

Gets or sets a normalized version of the token.

Start

Gets or sets the index of the first character of the token within the input.

Text

Gets or sets the original text of the token.

Applies to

See also