SearchQueryTokenizer (Atlassian Confluence 8.6.0 API)

All Known Implementing Classes:

LuceneSearchQueryTokenizer
```
public interface SearchQueryTokenizer
```
Breaks a text of a text field into tokens. A plugin can obtain it via ComponentImport. The AnalyzerDescriptor will provide an implementation of the service enough information to do the job.

Since:

7.0

Method Summary

All Methods Instance Methods Abstract Methods
Modifier and Type	Method	Description
`Collection<String>`	`tokenize(String fieldName, AnalyzerDescriptorProvider analyzerProvider, String text)`	Tokenize a string using the given analyzer.
`Collection<String>`	`tokenize(String fieldName, String text)`	Tokenize a string using the default analyzer provided by Confluence.

- Method Detail
  - tokenize
```
Collection<String> tokenize(String fieldName,
                            AnalyzerDescriptorProvider analyzerProvider,
                            String text)
```
    Tokenize a string using the given analyzer.
    
    Parameters:
    
    fieldName - field name
    
    text - text to be broken into tokens
    
    analyzerProvider - information about how to tokenized
    
    Returns:
    
    stream of tokens
  - tokenize
```
Collection<String> tokenize(String fieldName,
                            String text)
```
    Tokenize a string using the default analyzer provided by Confluence.
    
    Parameters:
    
    fieldName - field name
    
    text - text to be broken into tokens
    
    Returns:
    
    stream of tokens