Fix typo in documentation. toto -> to

This commit is contained in:
Nikolay Korolev 2019-11-22 22:56:43 +03:00 committed by Julien Chaumond
parent 26db31e0c0
commit 041a901f32
1 changed files with 1 additions and 1 deletions

View File

@ -184,7 +184,7 @@ class GPT2Tokenizer(PreTrainedTokenizer):
""" Tokenize a string.
Args:
- add_prefix_space (boolean, default False):
Begin the sentence with at least one space toto get invariance to word order in GPT-2 (and RoBERTa) tokenizers.
Begin the sentence with at least one space to get invariance to word order in GPT-2 (and RoBERTa) tokenizers.
"""
if add_prefix_space:
text = ' ' + text