[/==============================================================================
    Copyright (C) 2001-2008 Joel de Guzman
    Copyright (C) 2001-2008 Hartmut Kaiser

    Distributed under the Boost Software License, Version 1.0. (See accompanying
    file LICENSE_1_0.txt or copy at http://www.boost.org/LICENSE_1_0.txt)
===============================================================================/]

[section:lexer_primitives Lexer Primitives]

[/ Describe the primitive lexer constructs, such as token_def, token_set? ]

[/ Describe the primitive lexer constructs usable in parsers, such as 
   in_state[], set_state(), token(), etc. ]

[endsect]
