lucene::analysis::Tokenizer Class Reference
A Tokenizer is a TokenStream whose input is a Reader. More...
#include <AnalysisHeader.h>
Inheritance diagram for lucene::analysis::Tokenizer:
Public Member Functions | |
| Tokenizer () | |
| Construct a tokenizer with null input. | |
| Tokenizer (lucene::util::Reader *_input) | |
| Construct a token stream processing the given input. | |
| virtual void | close () |
| Releases resources associated with this stream. | |
| virtual | ~Tokenizer () |
Protected Attributes | |
| lucene::util::Reader * | input |
| The text source for this Tokenizer. | |
Detailed Description
A Tokenizer is a TokenStream whose input is a Reader.
This is an abstract class.
Constructor & Destructor Documentation
| lucene::analysis::Tokenizer::Tokenizer | ( | ) |
Construct a tokenizer with null input.
| lucene::analysis::Tokenizer::Tokenizer | ( | lucene::util::Reader * | _input | ) |
Construct a token stream processing the given input.
| virtual lucene::analysis::Tokenizer::~Tokenizer | ( | ) | [virtual] |
Member Function Documentation
| virtual void lucene::analysis::Tokenizer::close | ( | ) | [virtual] |
Releases resources associated with this stream.
Implements lucene::analysis::TokenStream.
Member Data Documentation
lucene:: util ::Reader* lucene::analysis::Tokenizer::input [protected] |
The text source for this Tokenizer.
The documentation for this class was generated from the following file: