Arthur 30b3c46ff5 [`split_special_tokens`] Add support for `split_special_tokens` argument to encode (#25081) ... * draft changes * update and add tests * styling for no * move test * path to usable model * update test * small update * update bertbased tokenizers * don'tuse kwargs for _tokenize * don'tuse kwargs for _tokenize * fix copies * update * update test for special tokenizers * fixup * skip two tests * remove pdb breakpiont() * wowo * rewrite custom tests * nits * revert chang in target keys * fix markup lm * update documentation of the argument		2023-08-18 13:26:27 +02:00
..
__init__.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
test_image_processing_layoutlmv2.py	Refactor image processor testers (#25450)	2023-08-11 11:30:18 +01:00
test_modeling_layoutlmv2.py	CI with `num_hidden_layers=2` 🚀🚀🚀 (#25266)	2023-08-02 20:22:36 +02:00
test_processor_layoutlmv2.py	Apply ruff flake8-comprehensions (#21694)	2023-02-22 09:14:54 +01:00
test_tokenization_layoutlmv2.py	[`split_special_tokens`] Add support for `split_special_tokens` argument to encode (#25081)	2023-08-18 13:26:27 +02:00