lib/Lex/Lexer.cpp

14 // TODO: GCC Diagnostics emitted by the lexer:
118 /// Lexer constructor - Create a new lexer object for the specified buffer
119 /// with the specified preprocessor managing the lexing process.  This lexer
141 /// Lexer constructor - Create a new raw lexer object.  This object is only
142 /// suitable for calls to 'LexFromRawLexer'.  This lexer assumes that the text
154 /// Lexer constructor - Create a new raw lexer object.  This object is only
155 /// suitable for calls to 'LexFromRawLexer'.  This lexer assumes that the text
168 /// Create_PragmaLexer: Lexer constructor - Create a new lexer object for
178 /// normal lexer that remaps tokens as they fly by.  This would require making
179 /// Preprocessor::Lex virtual.  Given that, we could just dump in a magic lexer
181 /// out of the critical path of the lexer!
189   // Create the lexer as if we were going to lex the file normally.
194   // Now that the lexer is created, change the start/end locations so that we
209   // Ensure that the lexer thinks it is inside a directive, so that end \n will
213   // This lexer really is for _Pragma.
323   Lexer lexer(SM.getLocForStartOfFile(locInfo.first), options,
326   lexer.LexFromRawLexer(token);
399     // Compute the start of the token in the input lexer buffer.
460   // Create a lexer starting at the beginning of this token.
501   // Create a lexer starting at the beginning of this token.
512       // Lexing this token has taken the lexer past the source location we're
559   // Create a lexer starting at the beginning of the file. Note that we use a
560   // "fake" file source location at offset 1 so that the lexer will track our
746   // lexer to parse it correctly.
1033 /// lexer buffer was all expanded at a single point, perform the mapping.
1074   // Otherwise, this is the _Pragma lexer case, which pretends that all of the
1199   Lexer lexer(SM.getLocForStartOfFile(LocInfo.first), LangOpts, File.begin(),
1203   lexer.LexFromRawLexer(Tok);
1787     // Search for the next '"' in hopes of salvaging the lexer. Unfortunately,
2104   // return immediately, so that the lexer can return this as an EOD token.
2397 /// uninterpreted string.  This switches the lexer out of directive mode.
2518 /// the specified lexer will return a tok::l_paren token, 0 if it is something
2520 /// lexer.
2546   // Restore the lexer back to non-skipping mode.
2867   // (After the LexTokenInternal call, the lexer might be destroyed.)
2872 /// LexTokenInternal - This implements a simple C family lexer.  It is an
2893     // skipped.  The next lexer invocation will return the token after the
2931     // We know the lexer hasn't changed, so just try again with this lexer.
2970     // We only saw whitespace, so just try again with this lexer.
3000     // We only saw whitespace, so just try again with this lexer.
3311       // We only saw whitespace, so just try again with this lexer.
3536         // We only saw whitespace, so just try again with this lexer.
3568         // We only saw whitespace, so just try again with this lexer.
3589     // this lexer.