mlyacc/mlyacclib/MLY_base-sig.sml

75 (* TOKEN: signature revealing the internal structure of a token. This signature
80    The representation of token was very carefully chosen here to allow the
86    type 'a token which functions to construct tokens would create.  A
87    constructor function for a integer token might be
89 	  INT: int * 'a * 'a -> 'a token.
96 	  INT: int * 'a * 'a -> (svalue,'a) token
106         datatype ('a,'b) token = TOKEN of LrTable.term * ('a * 'b * 'b)
107 	val sameToken : ('a,'b) token * ('a,'b) token -> bool
123 		     lexer : ('_b,'_c) Token.token Stream.stream,
144 			     (('_b,'_c) Token.token Stream.stream)
148    output will match.  The user is responsible for declaring type token,
151    Note that type token is abstract in the lexer.  This allows SML-Yacc to
153    treats the type token abstractly.  Lexers that are functors parametrized by
162 	        type ('a,'b) token
167          (UserDeclarations.svalue,UserDeclarations.pos) UserDeclarations.token
171    also take an argument before yielding a function from unit to a token
178 	        type ('a,'b) token
184          (UserDeclarations.svalue,UserDeclarations.pos) UserDeclarations.token
283 			 (svalue,pos) Token.token Stream.stream
290 	val parse : int * ((svalue,pos) Token.token Stream.stream) *
292 				result * (svalue,pos) Token.token Stream.stream
294 	val sameToken : (svalue,pos) Token.token * (svalue,pos) Token.token ->
315 			 (svalue,pos) Token.token Stream.stream
316 	val parse : int * ((svalue,pos) Token.token Stream.stream) *
318 				result * (svalue,pos) Token.token Stream.stream
320 	val sameToken : (svalue,pos) Token.token * (svalue,pos) Token.token ->