lexertl: The Modular Lexical Analyser Generator

Latest Version:

• 2011-12-07: lexertl.zip

Blog: here

What I'm Currently Working on

• Add tests and examples directories.
• C++11 specific headers for char32_t based typedefs (rules, state machine etc.)
• Use traits to optimise lookup.
• Support memory allocator parameter in templates.
• Use strong exception guarantee in rules class and anywhere else that it is reasonable to have it.
• Write more flexible file_iterator.
• Investigate auto minimisation of state machine.
• Recode char_state_machine to support re2c style generators.
• Write re2c style generator.
• Preparing for boost review.

Outstanding Features

• Redo code generator (in the style of re2c with ^, $ and multi-state support).
• Investigate Ville Laurikari's tagged DFAs in more depth.
• Implement POSIX Extensions support?

Boost

boost::spirit has had lexertl integrated for several years now. After discussing with Hartmut, I have decided not to supply a zip of boost::lexer directly anymore, but instead link to the docs here. lexertl will continue to be developed and will get new features and fixes implemented first (the boost version will have bug fixes applied shortly afterwards!) lexertl will continue to only require standard C++ support.