dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
transformers/utils/test_module/custom_tokenization.py

6 lines
88 B
Python
Raw Permalink Blame History

from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass
Reference in New Issue View Git Blame Copy Permalink