CompositeMentionTokenizer (Gene ID Mapper 2.5.0 API)

java.lang.Object
- de.julielab.genemapper.composites.CompositeMentionTokenizer

```
public class CompositeMentionTokenizer
extends Object
```
Special tokenization for composite concept resolution.

This class is used by FlairCompositeMentionTagger and the SimConceptCorpusToIOBConverter class in the gene mapper resources project.

- Constructor Summary
  
  Constructors
  Constructor Description
  
  CompositeMentionTokenizer()
- Method Summary
  
  All Methods Instance Methods Concrete Methods
  Modifier and Type Method Description
  
  Stream<CompositeToken> tokenize(String input)
  - Methods inherited from class java.lang.Object
    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail
- CompositeMentionTokenizer
```
public CompositeMentionTokenizer()
```

Method Detail

tokenize

public Stream<CompositeToken> tokenize(String input)