| Method and Description |
|---|
| net.sf.okapi.steps.tokenization.engine.javacc.SimpleCharStream.getColumn() |
| net.sf.okapi.steps.tokenization.engine.javacc.SimpleCharStream.getLine() |
| net.sf.okapi.steps.tokenization.locale.LocaleUtil.normalizeLanguageCode_Okapi(String)
don't use this. It only "understands" language + region,
but that is just a small part of what BCP 47 supports.
Also, the LocaleId does case normalization out of the box now.
|
| net.sf.okapi.steps.tokenization.locale.LocaleUtil.normalizeLanguageCodes_Okapi(List<String>)
don't use this. It only "understands" language + region,
but that is just a small part of what BCP 47 supports.
Also, the LocaleId does case normalization out of the box now.
|
Copyright © 2020. All rights reserved.