CLucene - a full-featured, c++ search engine
API Documentation
An Analyzer that uses WhitespaceTokenizer. More...
#include <Analyzers.h>
Public Member Functions | |
| TokenStream * | tokenStream (const TCHAR *fieldName, lucene::util::Reader *reader) |
| Creates a TokenStream which tokenizes all the text in the provided Reader. | |
| ~WhitespaceAnalyzer () | |
An Analyzer that uses WhitespaceTokenizer.
| lucene::analysis::WhitespaceAnalyzer::~WhitespaceAnalyzer | ( | ) | [inline] |
| TokenStream* lucene::analysis::WhitespaceAnalyzer::tokenStream | ( | const TCHAR * | fieldName, | |
| lucene::util::Reader * | reader | |||
| ) | [virtual] |
Creates a TokenStream which tokenizes all the text in the provided Reader.
Default implementation forwards to tokenStream(Reader) for compatibility with older version. Override to allow Analyzer to choose strategy based on document and/or field. Must be able to handle null field name for backward compatibility.
Implements lucene::analysis::Analyzer.