Tokenizer
in package
A tokenizer class.
Table of Contents
Properties
- $stack : array<string|int, string>
- A token stack.
- $streamReader : StreamReader
Methods
- __construct() : mixed
- Tokenizer constructor.
- clearStack() : mixed
- Clear the token stack.
- getNextToken() : false|string
- Get next token.
- getStreamReader() : StreamReader
- Get the stream reader instance.
- leapWhiteSpaces() : bool
- Leap white spaces.
- pushStack() : mixed
- Push a token onto the stack.
Properties
$stack
A token stack.
protected
array<string|int, string>
$stack
= []
$streamReader
protected
StreamReader
$streamReader
Methods
__construct()
Tokenizer constructor.
public
__construct(StreamReader $streamReader) : mixed
Parameters
- $streamReader : StreamReader
clearStack()
Clear the token stack.
public
clearStack() : mixed
getNextToken()
Get next token.
public
getNextToken() : false|string
Return values
false|stringgetStreamReader()
Get the stream reader instance.
public
getStreamReader() : StreamReader
Return values
StreamReaderleapWhiteSpaces()
Leap white spaces.
public
leapWhiteSpaces() : bool
Return values
boolpushStack()
Push a token onto the stack.
public
pushStack(string $token) : mixed
Parameters
- $token : string