Module LustreLexer

Lexer for Lustre input

This lexer supports nested include files by maintaining a stack of lexing buffers, with the one for the currently processed file at the top. If an include directive is encountered, open the referenced file, create a new lexing buffer and push it to the stack. Catch end of file exceptions, pop the now empty buffer of the stack, and continue with the buffer below.

Call lexbuf_init with the first channel to parse, and the directory to search for include files. Then create the lexing buffer with Lexing.from_function LustreLexer.read_from_lexbuf_stack.

Lexical conventions

The character sequence include "FILE", where FILE is a relative or absolute path, is replaced with the contents of FILE. The include directive may appear at any position in the input. Recursive includes are allowed. Positions are labeled by line, column and file name.

The token -- is a comment, everything following the token until the end of the line is discarded, unless the comment is a special comment, see below. Multi-line comments can be enclosed in /* and */, or (* and *).

The following special comments are parsed:

Unrecognized --% and --\@ comments result in a failure, but any --! comments are accepted with a warning.

author
Christoph Sticksel
exception Lexer_error of string
val lexbuf_init : Stdlib.in_channel -> string -> unit

Initialize the lexing function

val read_from_lexbuf_stack : bytes -> int -> int

Create a lexer reading from a stack of nested include files

val token : Stdlib.Lexing.lexbuf -> LustreParser.token

Entry point for the lexer