Raushan Turganbay 5ad960f1f4 Add Watermarking LogitsProcessor and WatermarkDetector (#29676) ... * add watermarking processor * remove the other hashing (context width=1 always) * make style * Update src/transformers/generation/logits_process.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/logits_process.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/logits_process.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/configuration_utils.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * update watermarking process * add detector * update tests to use detector * fix failing tests * rename `input_seq` * make style * doc for processor * minor fixes * docs * make quality * Update src/transformers/generation/configuration_utils.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/logits_process.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/watermarking.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/watermarking.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/watermarking.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * add PR suggestions * let's use lru_cache's default max size (128) * import processor if torch available * maybe like this * lets move the config to torch independet file * add docs * tiny docs fix to make the test happy * Update src/transformers/generation/configuration_utils.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/generation/watermarking.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * PR suggestions * add docs * fix test * fix docs * address pr comments * style * Revert "style" This reverts commit 7f33cc34ff. * correct style * make doctest green --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>		2024-05-14 13:31:39 +05:00
..
audio_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
file_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
generation_utils.md	Add Watermarking LogitsProcessor and WatermarkDetector (#29676)	2024-05-14 13:31:39 +05:00
image_processing_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
modeling_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
pipelines_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
time_series_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
tokenization_utils.md	Migrate doc files to Markdown. (#24376)	2023-06-20 18:07:47 -04:00
trainer_utils.md	translate internal folder files to chinese (#27638)	2023-12-04 10:04:28 -08:00