dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
transformers/tests/tokenization
History
SaulLu ae7bae8fe7
fix `train_new_from_iterator` in the case of byte-level tokenizers (#17549) 		2022-06-08 15:30:41 +02:00
..
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_tokenization_fast.py fix `train_new_from_iterator` in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
test_tokenization_utils.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00