Lines Matching defs:tokenizer
111 *The tokenizer
2743 * @a_tknzr: the tokenizer to use for the parsing.
2817 CRTknzr *tokenizer = NULL;
2820 tokenizer = cr_tknzr_new (a_input);
2821 g_return_val_if_fail (tokenizer, NULL);
2824 result = cr_parser_new (tokenizer);
2841 CRTknzr *tokenizer = NULL;
2843 tokenizer = cr_tknzr_new_from_uri (a_file_uri, a_enc);
2844 if (!tokenizer) {
2849 result = cr_parser_new (tokenizer);
4390 * @a_tknzr: the new tokenizer.
4414 *@a_tknzr: out parameter. The returned tokenizer
4416 *Getter of the parser's underlying tokenizer