Struct RuntimeTokenizerPosition
Represents a read-only tokenizer position.
public readonly record struct RuntimeTokenizerPosition : IEquatable<RuntimeTokenizerPosition>
- Implements
- Inherited Members
- Extension Methods
Constructors
RuntimeTokenizerPosition(int, int)
Represents a read-only tokenizer position.
public RuntimeTokenizerPosition(int Index, int Length)
Parameters
Properties
Index
Current token start index.
public int Index { get; init; }
Property Value
Length
Current token length.
public int Length { get; init; }