See: Description
| Class | Description |
|---|---|
| BertFullTokenizer |
BertFullTokenizer runs end to end tokenization of input text
|
| BertToken |
BertToken contains all the information for Bert model after encoding question and paragraph.
|
| BertTokenizer |
BertTokenizer is a class to help you encode question and paragraph sentence.
|
| WordpieceTokenizer |
WordpieceTokenizer tokenizes a piece of text into its word pieces.
|