Class Token

Namespace

Utils.Parser.Runtime

Assembly

Utils.Parser.dll

An atomic lexical unit produced by LexerEngine. Each token records its source position, the rule that matched it, the active lexer mode at the time of the match, and the matched text.

public record Token : IEquatable<Token>

Inheritance

object

Token

Implements

IEquatable<Token>

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

DataUtils.ToDbValue(object?)

MathEx.Clamp<T>(T, T, T, IComparer<T>)

FluentExtensions.Failure<T>(T)

FluentExtensions.IsEqualTo<T, CT>(T, CT)

FluentExtensions.IsGreaterOrEqualsThan<T, CT>(T, CT)

FluentExtensions.IsGreaterThan<T, CT>(T, CT)

FluentExtensions.IsIn<T>(T, params T[])

FluentExtensions.IsLowerOrEqualsThan<T, CT>(T, CT)

FluentExtensions.IsLowerThan<T, CT>(T, CT)

FluentExtensions.IsNotIn<T>(T, params T[])

FluentExtensions.IsNotNull<T>(T)

FluentExtensions.IsNull<T>(T)

FluentExtensions.Success<T>(T)

FluentExtensions.Test<T>(T, Func<T, bool>)

ObjectUtils.Between<T>(T, IComparer<T>, T, T)

ObjectUtils.Between<T>(T, IComparer<T>, T, T, bool, bool)

ObjectUtils.DoAsync<T, Result>(T, Func<T, Task<Result>>, Func<Task<Result>>)

ObjectUtils.DoAsync<T, Result>(T, Func<T, Task<Result>>, Result)

ObjectUtils.DoAsync<T, Result>(T, Func<T, Result>, Func<Result>)

ObjectUtils.DoAsync<T, Result>(T, Func<T, Result>, Result)

ObjectUtils.Do<T, Result>(T, Func<T, Result>, Func<Result>)

ObjectUtils.Do<T, Result>(T, Func<T, Result>, Result)

ObjectUtils.In<T>(T, params T[])

ObjectUtils.NotIn<T>(T, params T[])

Validations.ArgMustBe<T>(T, Func<T, bool>, string, string)

Validations.ArgMustNotBe<T>(T, Func<T, bool>, string, string)

Validations.Arg<T>(T, string)

Validations.ValueMustNotBeNull<T>(T, string)

Validations.Variable<T>(T, string)

Constructors

Token(SourceSpan, string, string, string, string)

An atomic lexical unit produced by LexerEngine. Each token records its source position, the rule that matched it, the active lexer mode at the time of the match, and the matched text.

public Token(SourceSpan Span, string RuleName, string ModeName, string Channel, string Text)

Parameters

Span SourceSpan

Position and length of the token in the source text.

RuleName string

Name of the lexer rule that produced this token, for example "ID".

ModeName string

Name of the active lexer mode when this token was produced.

Channel string

Channel name assigned to this token.

Text string

Raw matched text.

Properties

Channel

Channel name assigned to this token.

public string Channel { get; init; }

Property Value

string

ModeName

Name of the active lexer mode when this token was produced.

public string ModeName { get; init; }

Property Value

string

RuleName

Name of the lexer rule that produced this token, for example "ID".

public string RuleName { get; init; }

Property Value

string

Span

Position and length of the token in the source text.

public SourceSpan Span { get; init; }

Property Value

SourceSpan

Text

Raw matched text.

public string Text { get; init; }

Property Value

string