b369e507aa
Generate: text generation pipeline no longer emits `max_length` warning when it is not set ( #23139 )
2023-05-04 18:36:23 +01:00
516dc6305f
[docs] Text to speech task guide ( #23107 )
...
* First draft
* Some polishing
* Text polishing
* added TOC entry for TTS
* make style
* added links to images
* fixed links to images
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* feedback addressed
* feedback from Matthijs addresed
* Update docs/source/en/tasks/text-to-speech.mdx
Co-authored-by: Matthijs Hollemans <mail@hollance.com>
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Matthijs Hollemans <mail@hollance.com>
2023-05-04 13:17:13 -04:00
c8f2c5c56e
Add FlaxWhisperForAudioClassification model ( #22883 )
...
* Add FlaxWhisperForAudioClassification model
* Add models to init
* Add models to init
* Fix copies
* Fix automapping
2023-05-04 13:00:16 -04:00
3341bb41cd
Pin urllib3
2023-05-04 12:00:22 -04:00
57ffd8ab4c
[`GPT-J`] Fix causal mask dtype ( #23147 )
...
* fix #23136
* better fix
* same fix for `masked_bias`
2023-05-04 16:31:19 +02:00
83b38fbea8
GPTNeoXForQuestionAnswering ( #23059 )
...
* first draft - gives index error in question_answering.py
* maturing
* no labels
* pipeline should know about QA
* fixing checks
* formatting
* fixed docstring
* initial commit
* formatting
* adding the class to many places
* towards less unhappy checks
* nearly there
* and gpt neox for qa
* use right model
* forgot this one
* base_model_prefix is "gpt_neox" for GPTNeoX* models
* unnecessary stuff
* Update src/transformers/models/gpt_neox/modeling_gpt_neox.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* format
* Update src/transformers/models/gpt_neox/modeling_gpt_neox.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* removed gpt2 stuff
---------
Co-authored-by: Prof. Peter Schneider-Kamp <jps@ordbogen.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-05-04 10:15:15 -04:00
510ad0a8b8
gpt2 multi-gpu fix ( #23149 )
...
Co-authored-by: Prof. Peter Schneider-Kamp <jps@ordbogen.com>
2023-05-04 09:58:38 -04:00
adb0760b5f
fix resume fsdp ( #23111 )
...
* fix resume fsdp
* fix rank 0 loading
* fix style and quality
2023-05-04 09:57:32 -04:00
3b74889e8f
Remove typo in perf_train_gpu_many.mdx ( #23144 )
...
- Excess `w` in the word `bottom`
2023-05-04 09:56:45 -04:00
5eeb556484
fix spelling error ( #23143 )
...
change referrred to referred
2023-05-04 09:56:28 -04:00
90e8263d91
Add methods to update and verify out_features out_indices ( #23031 )
...
* Add methods to update and verify out_features out_indices
* Safe update for config attributes
* Fix function names
* Save config correctly
* PR comments - use property setters
* PR comment - directly set attributes
* Update test
* Add updates to recently merged focalnet backbone
2023-05-04 10:15:06 +01:00
78b7debf56
GPTNeoForQuestionAnswering ( #23057 )
...
* first draft - gives index error in question_answering.py
* maturing
* no labels
* pipeline should know about QA
* fixing checks
* formatting
* fixed docstring
* initial commit
* formatting
* adding the class to many places
* towards less unhappy checks
* nearly there
* Update src/transformers/models/gpt_neo/modeling_gpt_neo.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* avoid error
* moving to device of star/end_logits
---------
Co-authored-by: Prof. Peter Schneider-Kamp <jps@ordbogen.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-05-03 15:59:19 -04:00
b6933d76d2
Tidy Pytorch GLUE benchmark example ( #23134 )
...
Migration to Evaluate for metric is not quite complete
2023-05-03 15:50:41 -04:00
b0a78091a5
Remove redundant print statements ( #23133 )
...
remove redundant print statements
2023-05-03 18:04:48 +01:00
e3ee45aa54
Enable to use custom tracer in FX `symbolic_trace` ( #23105 )
...
* Enable to use custom tracer in FX `symbolic_trace`
* Integrate feedback from review
* Formatting
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-05-03 12:47:36 -04:00
441658dd6c
Add focalnet backbone ( #23104 )
...
Adds FocalNet backbone to return features from all stages
2023-05-03 19:32:42 +03:00
ca7eb27ed5
[doc] Try a few ≠ ways of linking to Papers, users, and org profiles ( #22611 )
...
* [doc] Try a few ≠ ways of linking to Papers, users, and org profiles
* Empty commit
* Empty commit now that the backend is fixed
---------
Co-authored-by: Lysandre <lysandre@huggingface.co>
2023-05-03 18:23:09 +02:00
fbe0178f08
docs: ko: update `_toctree.yml` ( #23112 )
...
* docs: ko: update `_toctree.yml`
* fix: ko: update toc
* fix: resolve suggestions
* fix: resolve build issue
---------
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com>
2023-05-03 11:04:58 -04:00
c4e32e206f
Add support for beam search's num_return_sequencs flag in flax ( #23082 )
...
* add code for numReturnSeq
* add flax support for num return sequences
* Make Fix up for changes
* add test for num return sequences
* lint
2023-05-03 10:50:34 -04:00
ee4bc07474
Support union types `X | Y` syntax for `HfArgumentParser` for Python 3.10+ ( #23126 )
...
* Support union types `X | Y` syntax for `HfArgumentParser` for Python 3.10+
* Add tests for PEP 604 for `HfArgumentParser`
* Reorganize tests
2023-05-03 10:49:54 -04:00
56b8d49ddf
Fix ConvNext V2 paramater naming issue ( #23122 )
...
Fixes the parameter naming issue in ConvNextV2GRN module
2023-05-03 17:21:27 +03:00
b53004fdce
Add resources for LayoutLmV2 and reformat documentation resources ( #23115 )
...
* add resources for layoutlmv2
* remove 🌎 from some resources
2023-05-03 09:53:00 -04:00
3a08dc63fd
Generate: better warnings with pipelines ( #23128 )
2023-05-03 14:43:17 +01:00
2a16d8b275
improve unclear documentation ( #23123 )
2023-05-03 09:36:30 -04:00
a0bd464776
Generate: correct beam search length on score calculation for multi batch generation ( #23127 )
2023-05-03 14:29:55 +01:00
ce31e3c8bf
Generate: slow assisted generation test ( #23125 )
2023-05-03 14:24:50 +01:00
b61d5b47f6
[`Doctest`] Fix pix2struct doctest ( #23121 )
...
fix pix2struct doctest
2023-05-03 11:21:59 +02:00
4b6aecb48e
Pin numba for now ( #23118 )
2023-05-02 22:02:39 -04:00
3ff89f29f5
Fixed default config for `Pix2Struct` model to set `Pix2StructTextModel` to `is_decoder=True` ( #23051 )
...
added as default keyword arg. to in order to correctly configure the decoder
2023-05-02 13:40:41 -04:00
805db1fe13
num_noise_spans should be <= num_items #22246 ( #22938 )
2023-05-02 13:07:30 -04:00
9ade58f055
[ONNX] Sam fix ( #23110 )
...
* [WIP] Fix for the ONNX export
* Apply changes
* Remove commented code
* Resolve todo
* empty -> zeros
* fix slow tests
---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
2023-05-02 17:20:02 +02:00
4baa34c18f
[`Flava`] Fix flava `torch.distributed.nn.functional import all_gather` issue ( #23108 )
...
* fix flava `torch.distributed.nn.functional import all_gather` issue
* more comments
2023-05-02 15:35:57 +02:00
c6c6658499
Fix check for backword_pos ( #23075 )
2023-05-02 09:32:42 -04:00
f31a510bb3
🌐 [i18n-KO] Translated `torchscript.mdx` to Korean ( #23060 )
...
* docs: ko: torchscript.mdx
* feat: gpt and deepl draft
* fix: manual edits
* fix: edit anchor link
* fix: resolve suggestions
Co-authored-by: Hyeonseo Yun <0525yhs@gmail.com>
* fix: resolve suggestions
---------
Co-authored-by: Hyeonseo Yun <0525yhs@gmail.com>
2023-05-02 09:27:59 -04:00
2b0c924568
GPT2ForQuestionAnswering ( #23030 )
...
* first draft - gives index error in question_answering.py
* maturing
* no labels
* pipeline should know about QA
* fixing checks
* formatting
* fixed docstring
* make sure legacy code executes
* comment
* like this
---------
Co-authored-by: Prof. Peter Schneider-Kamp <jps@ordbogen.com>
2023-05-02 09:25:46 -04:00
bcedd0a471
Save the tokenizer and image preprocessor after training a model with the contrastive image-text example ( #23035 )
...
Save tokenizer and image preprocessor
2023-05-02 09:23:16 -04:00
85e3d7b6a0
added type hints for blip_text pytorch model ( #23071 )
...
* added type hints for blip_text pytorch model
* updated type hints for blip_text pytorch model
2023-05-02 13:22:31 +01:00
b8648290d2
Bump flask from 2.0.3 to 2.3.2 in /examples/research_projects/decision_transformer ( #23094 )
...
Bump flask in /examples/research_projects/decision_transformer
Bumps [flask](https://github.com/pallets/flask ) from 2.0.3 to 2.3.2.
- [Release notes](https://github.com/pallets/flask/releases )
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst )
- [Commits](https://github.com/pallets/flask/compare/2.0.3...2.3.2 )
---
updated-dependencies:
- dependency-name: flask
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-01 20:15:11 -04:00
f9426eeb94
🌐 [i18n-KO] Translated `tasks/zero_shot_image_classification.mdx` to Korean ( #23065 )
...
docs: ko: `tasks/zero_shot_image_classification`
Co-authored-by: Hyeonseo Yun <0525_hhgus@naver.com>
Co-authored-by: Gabriel Yang <gabrielwithhappy@gmail.com>
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com>
2023-05-01 20:11:56 -04:00
92601d2eb1
🌐 [i18n-KO] Translated `tasks/question_answering.mdx` to Korean ( #23012 )
...
docs: ko: `tasks/question_answering.mdx` to Korean
Co-authored-by: Hyeonseo Yun <0525yhs@gmail.com>
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
Co-authored-by: Hyeonseo Yun <0525_hhgus@naver.com>
Co-authored-by: Gabriel Yang <gabrielwithhappy@gmail.com>
Co-authored-by: Kihoon Son <75935546+KIHOON71@users.noreply.github.com>
2023-05-01 11:05:40 -04:00
78941b9fe5
🌐 [i18n-KO] Translated `tasks/image_classification.mdx` to Korean ( #23048 )
...
* ko: init: tasks/image_classification.mdx
* docs: ko: trans: tasks/image_classification.mdx
* docs: ko: revise: sync glossary and spell check tasks/image_classification.mdx
* docs: ko: revise: sync glossary tasks/image_classification.mdx
* fix: resolve suggestions (github) image_classification.mdx
Only github code review suggestion
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
* fix: resolve suggestions image_classification.mdx
Co-Authored-By: Gabriel Yang <gabrielwithhappy@gmail.com>
---------
Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
Co-authored-by: Gabriel Yang <gabrielwithhappy@gmail.com>
2023-05-01 09:50:05 -04:00
9884862383
Depricate xpu_backend for ddp_backend ( #23085 )
...
* Depricate xpu_backend for ddp_backend
* Typo
* Only do a minor deprecation, no need for major
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-05-01 09:44:47 -04:00
95cf3725b4
Fix `convnext` __init__ ( #23078 )
...
fix
2023-05-01 09:36:42 -04:00
487f132a6f
Add `BioGPTForSequenceClassification` ( #22253 )
...
* added BioGptForSequenceClassification
* added source of copied code
* typo
* Format code with black
* Update comments for copied code
* Remove code copy comment
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Fix failing tests
* Update code copied from comments
* Fix code quality
* Update src/transformers/models/biogpt/modeling_biogpt.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Fix lint error
* Update src/transformers/models/biogpt/modeling_biogpt.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Rename model to biogpt for consistency
* Add PipelineTesterMixin to test_modeling_biogpt.py
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Resolve merge confict
---------
Co-authored-by: Guillem García Subies <37592763+GuillemGSubies@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-05-01 09:17:27 -04:00
549e5f9f23
Fix string syntax error in logger warning message (additional comma) ( #23083 )
2023-05-01 09:14:16 -04:00
9062d1bab2
Fix grammar error in summarization pipeline ( #23080 )
...
Fix minor grammar issue
2023-05-01 08:54:57 -04:00
849367ccf7
Generate: prepare assisted generation for release ( #23052 )
2023-04-29 10:53:30 +01:00
dfeb5aa6a9
extend the test files ( #23043 )
...
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2023-04-28 22:25:34 +02:00
b6865b9bef
Fix model parallelism for `BridgeTower` ( #23039 )
...
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2023-04-28 21:53:58 +02:00
d337631b91
🚨 🚨 🚨 [`Blip`] remove labels masking ( #23024 )
...
* remove labels masking
* add fix on blip tf
2023-04-28 18:24:51 +02:00
Joao Gante