dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update run_t5_mlm_flax.py (#16421) 

Fix typo in comment: proprocessed -> preprocessed
This commit is contained in:
Yongrae Jo 2022-03-28 19:00:53 +09:00 committed by GitHub
parent 925fc57b70
commit 8049dfa427
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/flax/language-modeling/run_t5_mlm_flax.py
View File

@ -338,7 +338,7 @@ class FlaxDataCollatorForT5MLM:
f"`labels` are incorrectly preprocessed. `labels` length is {batch['labels'].shape[-1]}, but should be {self.target_length}."
)
# to check that tokens are correctly proprocessed, one can run `self.tokenizer.batch_decode(input_ids)` and `self.tokenizer.batch_decode(labels)` here...
# to check that tokens are correctly preprocessed, one can run `self.tokenizer.batch_decode(input_ids)` and `self.tokenizer.batch_decode(labels)` here...
batch["decoder_input_ids"] = shift_tokens_right(
batch["labels"], self.pad_token_id, self.decoder_start_token_id
)