TokenInfo Class

Definition

Information about a token returned by an analyzer.

public class TokenInfo
type TokenInfo = class
Public Class TokenInfo
Inheritance
TokenInfo

Constructors

TokenInfo()

Initializes a new instance of the TokenInfo class.

TokenInfo(String, Nullable<Int32>, Nullable<Int32>, Nullable<Int32>)

Initializes a new instance of the TokenInfo class.

Properties

EndOffset

Gets the index of the last character of the token in the input text.

Position

Gets the position of the token in the input text relative to other tokens. The first token in the input text has position 0, the next has position 1, and so on. Depending on the analyzer used, some tokens might have the same position, for example if they are synonyms of each other.

StartOffset

Gets the index of the first character of the token in the input text.

Token

Gets the token returned by the analyzer.

Applies to