classTokenStream

final class TokenStream

Restricted visibility: declared "@visibility root". Code outside that scope must not name this declaration.

Tokens read one at a time, with one token of lookahead.

Methods§

public function __construct(private non-empty-list<Token> $tokens)

$tokens non-empty-list<Token> The tokens, ending with an end-of-file token

public function peek(): Token

Looks at the next token without taking it.

Token The next token, or the end-of-file token

Test cases 6

Called from 2

Calls 1

public function next(): Token

Takes the next token.

Token The token taken; the end-of-file token is taken again and again

Test cases 13

Called from 16

Calls 2

public function eof(): bool

Reports whether the file has ended.

bool True at the end-of-file token

Test cases 3

Called from 1

Calls 2

Implementation details, listed for orientation only.

private int $position = 0

private non-empty-list<Token> $tokens

Test cases that cover or call this symbol, from the coverage report and from the analyzed test sources.

Dedicated tests 3

Other tests reaching this symbol 51

Instantiated in 1

Method calls 17

Type declarations 16