LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString Method

Definition

Overloads

TokenizeString(String) TokenizeString(String) TokenizeString(String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

TokenizeString(SourceLocation, String) TokenizeString(SourceLocation, String) TokenizeString(SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

TokenizeString(String) TokenizeString(String) TokenizeString(String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (string content);
abstract member TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
Public Overridable Function TokenizeString (content As String) As IEnumerable(Of TSymbol)
Parameters
content
String String String

The string to tokenize.

Returns
IEnumerable<TSymbol>

The collection of token.

TokenizeString(SourceLocation, String) TokenizeString(SourceLocation, String) TokenizeString(SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (System.Web.Razor.Text.SourceLocation start, string input);
abstract member TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
Public Iterator Overridable Function TokenizeString (start As SourceLocation, input As String) As IEnumerable(Of TSymbol)
Parameters
start
SourceLocation SourceLocation SourceLocation

The source location as the start marker for the tokenizer.

input
String String String

The string to tokenize.

Returns
IEnumerable<TSymbol>

The collection of token.

Applies to