NielsRogge
|
5f789a687a
|
Add LayoutXLMProcessor (and LayoutXLMTokenizer, LayoutXLMTokenizerFast) (#14115)
* Add LayoutXLMTokenizer and LayoutXLMTokenizerFast
* Fix styling issues
* Fix more styling issues
* Fix more styling issues
* Fix docstring
* Fix unit tests
* Fix docs
* Fix unit tests
* Fix typos and styling issues
* Fix styling issues
* Fix docstring
* Make all tests of test_tokenization_layoutxlm pass
* Add LayoutXLMProcessor
* Make fixup
* Make all LayoutXLMProcessor tests pass
* Minor fixes
* Leave LayoutLMv2Processor tests unchanged
* Fix code quality
* Move LayoutXLM tokenizers and processor to separate folder
* Fix code quality
* Apply suggestions from code review
* Replace assertions by value errors
* Remove methods from fast tokenizer
Co-authored-by: King Yiu Suen <kingyiusuen@gmail.com>
|
2021-11-03 08:59:44 +01:00 |