Class TokenizerRuntimeException
Represents a tokenization error raised by TokenizerRuntime.
public sealed class TokenizerRuntimeException : Exception, ISerializable
- Inheritance
-
TokenizerRuntimeException
- Implements
- Inherited Members
- Extension Methods
Constructors
TokenizerRuntimeException(string, int)
Represents a tokenization error raised by TokenizerRuntime.
public TokenizerRuntimeException(string token, int index)
Parameters
Properties
Index
Gets the index where tokenization failed.
public int Index { get; }
Property Value
Token
Gets the token or character that could not be recognized.
public string Token { get; }