TokenFilterName Struct

Definition

Defines the names of all token filters supported by Azure Search.

[Newtonsoft.Json.JsonConverter(typeof(Microsoft.Azure.Search.Serialization.ExtensibleEnumConverter`1<Microsoft.Azure.Search.Models.TokenFilterName>))]
public struct TokenFilterName : IEquatable<Microsoft.Azure.Search.Models.TokenFilterName>
type TokenFilterName = struct
Public Structure TokenFilterName
Implements IEquatable(Of TokenFilterName)
Inheritance
TokenFilterName
Attributes
Implements

Fields

Apostrophe

Strips all characters after an apostrophe (including the apostrophe itself).

ArabicNormalization

A token filter that applies the Arabic normalizer to normalize the orthography.

AsciiFolding

Converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if such equivalents exist.

CjkBigram

Forms bigrams of CJK terms that are generated from StandardTokenizer.

CjkWidth

Normalizes CJK width differences. Folds fullwidth ASCII variants into the equivalent basic Latin, and half-width Katakana variants into the equivalent Kana.

Classic

Removes English possessives, and dots from acronyms.

CommonGram

Construct bigrams for frequently occurring terms while indexing. Single terms are still indexed too, with bigrams overlaid.

EdgeNGram

Generates n-grams of the given size(s) starting from the front or the back of an input token.

Elision

Removes elisions. For example, "l'avion" (the plane) will be converted to "avion" (plane).

GermanNormalization

Normalizes German characters according to the heuristics of the German2 snowball algorithm.

HindiNormalization

Normalizes text in Hindi to remove some differences in spelling variations.

IndicNormalization

Normalizes the Unicode representation of text in Indian languages.

KeywordRepeat

Emits each incoming token twice, once as keyword and once as non-keyword.

KStem

A high-performance kstem filter for English.

Length

Removes words that are too long or too short.

Limit

Limits the number of tokens while indexing.

Lowercase

Normalizes token text to lower case.

NGram

Generates n-grams of the given size(s).

PersianNormalization

Applies normalization for Persian.

Phonetic

Create tokens for phonetic matches.

PorterStem

Uses the Porter stemming algorithm to transform the token stream.

Reverse

Reverses the token string.

ScandinavianFoldingNormalization

Folds Scandinavian characters åÅäæÄÆ->a and öÖøØ->o. It also discriminates against use of double vowels aa, ae, ao, oe and oo, leaving just the first one.

ScandinavianNormalization

Normalizes use of the interchangeable Scandinavian characters.

Shingle

Creates combinations of tokens as a single token.

Snowball

A filter that stems words using a Snowball-generated stemmer.

SoraniNormalization

Normalizes the Unicode representation of Sorani text.

Stemmer

Language specific stemming filter.

Stopwords

Removes stop words from a token stream.

Trim

Trims leading and trailing whitespace from tokens.

Truncate

Truncates the terms to a specific length.

Unique

Filters out tokens with same text as the previous token.

Uppercase

Normalizes token text to upper case.

WordDelimiter

Splits words into subwords and performs optional transformations on subword groups.

Methods

Equals(Object)

Determines whether the specified object is equal to the current object.

Equals(TokenFilterName)

Compares the TokenFilterName for equality with another TokenFilterName.

GetHashCode()

Serves as the default hash function.

ToString()

Returns a string representation of the TokenFilterName.

Operators

Equality(TokenFilterName, TokenFilterName)

Compares two TokenFilterName values for equality.

Explicit(TokenFilterName to String)

Defines explicit conversion from TokenFilterName to string.

Implicit(String to TokenFilterName)

Defines implicit conversion from string to TokenFilterName.

Inequality(TokenFilterName, TokenFilterName)

Compares two TokenFilterName values for inequality.

Applies to