Class PhpParser\Lexer

PhpParser\Lexer
- ApiGen\Analyzer\BodySkippingLexer

Methods


					
	public

tokenize(string $code, ErrorHandler|null $errorHandler = null): Token[]

Tokenize the provided source code. The token array is in the same format as provided by the PhpToken::tokenize() method in PHP 8.0. The tokens are instances of PhpParser\Token, to abstract over a polyfill implementation in earlier PHP version. The token array is terminated by a sentinel token with token ID 0. The token array does not discard any tokens (i.e. whitespace and comments are included). The token position attributes are against this token array.

Parameters

`$code`	The source code to tokenize.
`$errorHandler`	Error handler to use for lexing errors. Defaults to ErrorHandler\Throwing.

Returns

Tokens


					
	protected

postprocessTokens(list<Token> &$tokens, ErrorHandler $errorHandler): void

Overridden by

ApiGen\Analyzer\BodySkippingLexer::postprocessTokens()

Namespaces

Classes

Interfaces

Exceptions

Class PhpParser\Lexer

Parameters

Returns

Overridden by