0b36c2d665
indent?
2024-04-17 11:57:30 +02:00
eb75516e7c
Fix `Fatal Python error: Bus error` in `ZeroShotAudioClassificationPipelineTests` ( #30283 )
...
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-17 11:47:30 +02:00
05dab4e5ba
Fix test `ExamplesTests::test_run_translation` ( #30281 )
...
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-17 11:46:33 +02:00
304c6a1e0d
Enable fx tracing for Mistral ( #30209 )
...
* tracing for mistral
* typo
* fix copies
2024-04-17 14:38:48 +05:00
98717cb341
Configuring Translation Pipelines documents update #27753 ( #29986 )
...
* Configuring Translation Pipelines documents update #27753
Configuring Translation Pipelines documents update
* Language Format Addition
* adding supported list of languages list
2024-04-17 11:27:49 +02:00
080b700805
FIX / AWQ: Fix failing exllama test ( #30288 )
...
fix filing exllama test
2024-04-17 11:26:35 +02:00
4114524706
Fix SpeechT5 forward docstrings ( #30287 )
2024-04-17 11:23:49 +02:00
40eb6d6c5f
Fix SDPA sliding window compatibility ( #30127 )
...
* fix sdpa + sliding window
* give credit
Co-authored-by: ehuaa <ehuamail@163.com>
* remove unnecessary warning
* fix typog
* add test
---------
Co-authored-by: ehuaa <ehuamail@163.com>
2024-04-17 17:21:26 +08:00
5fabebdb7d
Fix test fetcher (doctest) + `Idefics2`'s doc example ( #30274 )
...
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-16 21:25:06 +02:00
37b5946a66
fix: Fixed a `raise` statement ( #30275 )
...
* Fixed a raise statement.
* Minor changes.
2024-04-16 18:49:40 +01:00
c63f158903
BLIP - fix pt-tf equivalence test ( #30258 )
...
* BLIP - fix pt-tf equivalence test
* Update tests/models/blip/test_modeling_blip.py
* Update more model tests
2024-04-16 17:46:53 +01:00
e27d9308be
Raise relevent err when wrong type is passed in as the accelerator_config ( #29997 )
...
* Raise relevent err
* Use type instead
2024-04-16 11:21:24 -04:00
0eaef0c709
add `push_to_hub` to pipeline ( #29172 )
...
* add `push_to_hub` to pipeline
* fix docs
* format with ruff
* update save_pretrained
* update save_pretrained
* remove unnecessary comment
* switch to push_to_hub method in DynamicPipelineTester
* remove unused imports
* update docs for add_new_pipeline
* fix docs for add_new_pipeline
* add comment
* fix italien docs
* changes to token retrieval for pipelines
* Update src/transformers/pipelines/base.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2024-04-16 15:34:04 +01:00
60dea593ed
Workflow: Update tailscale to release version ( #30268 )
...
Update tailscale to release version
2024-04-16 15:35:03 +02:00
487505ff45
Allow for str versions of dicts based on typing ( #30227 )
...
* Bookmark, initial impelemtation. Need to test
* Clean
* Working fully, woop woop
* I think working version now, testing
* Fin!
* rm cast, could keep None
* Fix typing issue
* rm typehint
* Add test
* Add tests and make more rigid
2024-04-16 08:15:09 -04:00
b86d0f4eca
FIX: Fix 8-bit serialization tests ( #30051 )
...
* fix 8-bit serialization tests
* add more clarification
* Update src/transformers/quantizers/quantizer_bnb_8bit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2024-04-16 12:28:10 +02:00
ddf5f2588f
FIX: Fix corner-case issue with the important models workflow ( #30212 )
...
* Update push-important-models.yml
* dummy commit
* Update modeling_bark.py
* test
* test
* test
* another test
* another test
* test
* final test
* final test
* test
* another test
* test
* test
* another test
* test llama
* revert everything
* remove echo
2024-04-16 11:15:57 +01:00
cbc2cc187a
More fixes for doctest ( #30265 )
...
* fix
* update
* update
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-16 11:58:55 +02:00
51bcadc10a
Update `ko/_toctree.yml` ( #30062 )
...
* fix: update `ko/_toctree.yml`
* fix: update ko/_toctree.yml
* Update docs/source/ko/_toctree.yml
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
* fix: delete `perf_infer_gpu_many`
* fix: Replace untranslated docs with `in_translation`
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
* fix: Replace untraslated docs with `in_translation`
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
2024-04-15 10:42:46 -07:00
5be21302ad
Remove incorrect arg in codellama doctest ( #30257 )
...
Remove incorrect arg in codellama docstring
2024-04-15 18:31:23 +01:00
8127f39624
[Docs] Update recurrent_gemma.md for some minor nits ( #30238 )
...
Update recurrent_gemma.md
2024-04-15 18:30:59 +02:00
6b78360e6d
Add Idefics2 ( #30253 )
...
* Initial add model additions
* Test
* All weights loading
* Can perform full forward pass
* Local and remote the same
* Matching local and remote
* Fixup
* Idefics2Model importable; fixup docstrings
* Don't skip by default
* Remove deprecated use_resampler arg
* Remove self.config
* DecoupledLinear takes config
* Tidy up
* Enable eager attention and tidy up
* Most tests passing
* Update for batch of processed images
* Add image processor
* Update doc pages
* Update conversion script
* Remove erroneous breakpoint
* Remove accidendtal spelling change
* Update to reflect changes on hub - make generate work
* Fix up
* Image processor tests
* Update tests
* Add a processor
* Add a processor
* Update convert script
* Update modeling file - remove fixmes
* Bug fix
* Add processing test
* Use processor
* Fix up
* Update src/transformers/models/idefics2/modeling_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update src/transformers/models/idefics2/modeling_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Fix test
* Update config - PR comments and defaults align with checkpoint
* Reviewer comments
* Add copied froms for flahs attention
* Update src/transformers/models/idefics2/modeling_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Remove qk_layer_norm and freeze_layers functionality
* Fix
* Remove freeze_layer options from config
* Sync with upstream main
* Fix attention shapes siglip
* Remove Llava-next refs - TO REBASE
* Use AutoModel for text model
* Add comment to explain vision embeddings
* Fix issue with tie_word_embeddings
* Address review comments
* Fix and fix up
* Chat templates for idefics
* Fix copies
* Fix
* Add layer norms to FA2
* Fix tests
* Apply suggestions from code review
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Fix
* Review comments
* Update src/transformers/models/idefics2/modeling_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update inputs merger
* Merge weights in correct order
* Update convert script
* Update src/transformers/models/idefics2/processing_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update template
* Model code examples (fix idefics too)
* More review comments
* Tidy up
* Update processing
* Fix attention mask preparation
* Update inputs_merger inputs
* Vectorize inputs_merger
* Update src/transformers/models/idefics2/__init__.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* Update src/transformers/models/idefics2/modeling_idefics2.py
* Review comments
* saying bye to the `qk_layer_norms`
* Simplify
* Update latents
* Remove erroneuous readme changes
* Return images when applying chat template
* Fix bug - prompt images are for a single sample
* Update src/transformers/models/idefics2/modeling_idefics2.py
* image splitting
* fix test
* some more comment
* some comment
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/idefics2/image_processing_idefics2.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update processor
* Update model tests
* Update src/transformers/models/idefics2/processing_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update src/transformers/models/idefics2/processing_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Don't add BOS in template
* Update src/transformers/models/idefics2/processing_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Remove index in examples
* Update tests to reflect #13
* Update src/transformers/models/idefics2/processing_idefics2.py
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* PR comment - consistent typing
* Update readme and model doc
* Update docs
* Update checkpoint references
* Update examples
* Fix and update tests
* Small addition
* Update tests - remove copied from as no ignore placement copy could be found
* Update example
* small fixes
* Update docs/source/en/model_doc/idefics2.md
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update docs/source/en/model_doc/idefics2.md
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Update README.md
Co-authored-by: Victor SANH <victorsanh@gmail.com>
* Connector model as bridge
* Fix up
* Fix up
* Don't pass model inputs for generation kwargs update
* IDEFICS-2 -> Idefics2
* Remove config archive name
* IDEFICS-2 -> Idefics2
* Add back llava-next
* Update readmes
* Add requirements for processor tester
* Use custom convert_to_rgb to avoid possible BC
* Fix doc example
* Fix doc example
* Skip model doc tests - as model to large
* More doc example - account for image splitting
* Update src/transformers/image_transforms.py
* Fix config doctest
---------
Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>
Co-authored-by: ArthurZucker <arthur.zucker@gmail.com>
Co-authored-by: Victor SANH <victorsanh@gmail.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
2024-04-15 17:03:03 +01:00
667939a2d3
[tests] add the missing `require_torch_multi_gpu` flag ( #30250 )
...
add gpu flag
2024-04-15 16:30:52 +01:00
440bd3c3c0
update github actions packages' version to suppress warnings ( #30249 )
...
update
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-15 15:08:09 +02:00
766810153b
round epoch only in console ( #30237 )
2024-04-15 13:53:21 +01:00
fe2d20d275
Fix doctest more (for `docs/source/en`) ( #30247 )
...
* fix
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-15 14:10:59 +02:00
ec344b560d
Separate out kwargs in processor ( #30193 )
...
* Separate out kwargs in processor
* Fix up
2024-04-15 12:36:50 +01:00
fc8eda36c5
fix: Fixed `type annotation` for compatability with python 3.8 ( #30243 )
...
* Fixed type annotation for compatability with python 3.8
* Fixed unsorted imports.
2024-04-15 12:31:37 +01:00
b6b6daf2b7
Refactor doctest ( #30210 )
...
* fix
* update
* fix
* update
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-15 13:20:36 +02:00
b3595cf02b
fix: Replaced deprecated `typing.Text` with `str` ( #30230 )
...
typing.Text is deprecated. Use str instead
2024-04-15 12:18:37 +01:00
f010786218
Set pad_token in run_glue_no_trainer.py #28534 ( #30234 )
2024-04-15 11:39:10 +01:00
06b1192768
fix: Replace deprecated `assertEquals` with `assertEqual` ( #30241 )
...
Replace deprecated assertEquals with assertEqual.
2024-04-15 09:36:06 +01:00
8fd2de933c
Add test for parse_json_file and change typing to os.PathLike ( #30183 )
...
* Add test for parse_json_file
* Change Path to PathLike
* Fix `Import block is un-sorted or un-formatted`
* revert parse_json_file
* Fix ruff format
* Add parse_json_file test
2024-04-15 09:34:36 +01:00
b109257f4f
Fixed config.json download to go to user-supplied cache directory ( #30189 )
...
* Fixed config.json download to go to user-supplied cache directory.
* Simplied implementation suggested by @amyeroberts
2024-04-12 18:03:49 +01:00
db7d155444
Fix/Update for doctest ( #30216 )
...
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-12 18:59:45 +02:00
4f7b434acb
Update modeling_bark.py ( #30221 )
...
Change .view() to .reshape() to prevent errors on non-contiguous tensors
2024-04-12 17:03:38 +01:00
bf9a7ab932
Fix `RecurrentGemmaIntegrationTest.test_2b_sample` ( #30222 )
...
fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-12 17:53:25 +02:00
65657d5d8a
fix fuyu doctest ( #30215 )
...
* fix doctest
* fix example
* fix
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2024-04-12 17:45:15 +02:00
ac33aeeeee
fix typo ( #30220 )
2024-04-12 15:41:35 +01:00
caa5c65db1
fix: Replaced deprecated `logger.warn` with `logger.warning` ( #30197 )
...
* Fixed deprecated logger.warn by using logger.warning
* Reformatted using ruff.
2024-04-12 10:21:24 +01:00
c82b38a3e2
Fix pipeline logger.warning_once bug ( #30195 )
...
Fix warning bug
2024-04-12 09:34:45 +01:00
2c66600c3f
ENH: [`CI`] Add new workflow to run slow tests of important models on push main if they are modified ( #29235 )
...
* v1
* v1
* more changes
* more models
* add more markers
* swtich to A10
* use cache
* Update .github/workflows/push-important-models.yml
* Update .github/workflows/push-important-models.yml
* Update modeling_llama.py
* test
* test
* another test
* test
* test
* attempt to fix
* fix
* try automatic tagging
* fix
* alternative approach for collecting
* fix
* fix
* fix
* test
* fix
* fix
* test
* revert some changes
* fix
* fix
* fix
* final push
* fix
* revert
* test new slack message
* oops
* Update send-slack.yml
* test
* test re-usable workflow in steps
* Update action.yml
* test
* another test
* test
* another test
* test
* another test
* another test (hopefully last one)
* attempt to fix
* allez
* removing comma
* test
* another test
* attempt
* test
* test
* test push
* test
* test
* another test
* test
* make it better
* fix commas
* valid json
* test
* another test
* test
* final push
* test
* final push
* more customizable messages
* test
* push
* oops
* another test
* another test
* missing indentation
* more tweaks
* more tweaks
* another test
* another test
* tests
* final push
* use global variables instead
* Update .github/workflows/push-important-models.yml
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* commit to test all models
* issue with arrays
* another test
* attempt to fix failing tests
* Update .github/workflows/push-important-models.yml
* add ssh
* Update .github/workflows/push-important-models.yml
* test
* test
* add install curl
* attempt to fix
* final fix
* test
* test
* test
* fix test
* another test
* add inherit secrets
* push
* revert unneeded changes
* revert
* add env variables
* add pip freeze
* revert change in gemma
* Update .github/workflows/push-important-models.yml
* fix mistral and mixtral
* add pdb
* fix mixtral tesst
* fix
* fix mistral ?
* add fix gemma
* fix mistral
* fix
* test
* anoter test
* fix
* fix
* fix mistral tests
* fix them again
* final fixes for mistral
* fix padding right
* fix whipser fa2
* fix
* fix
* fix gemma
* test
* fix llama
* fix
* fix
* fix llama gemma
* add class attribute
* fix CI
* clarify whisper
* compute_capability
* rename names in some comments
* Add # fmt: skip
* make style
* Update tests/models/mistral/test_modeling_mistral.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* update
* update
* change branch
* correct workflow
* modify file
* test
* works
* final test
* another fix
* install sudo
* final fix
* add `-y`
* set to `main`
* Update .github/actions/post-slack/action.yml
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* change title
* fixup
* add upload report
* fix
* revert to main
* add empty lines + add comment
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2024-04-12 10:01:28 +02:00
0bd58f1ce0
Docs PR template ( #30171 )
...
remove maria :(
2024-04-11 09:23:55 -07:00
edf0935dca
Falcon: make activation, ffn_hidden_size configurable ( #30134 )
...
* Falcon chg
* delta
* Docstring
* Fix import block
* doc
* fix and overwrite
2024-04-11 14:04:46 +01:00
5569552cf8
Update output of SuperPointForKeypointDetection ( #29809 )
...
* Remove auto class
* Update ImagePointDescriptionOutput
* Update model outputs
* Rename output class
* Revert "Remove auto class"
This reverts commit ed4a8f549d
2024-04-11 14:59:30 +02:00
386ef34e7d
[Processor classes] Update docs ( #29698 )
...
Update docs
2024-04-11 14:24:38 +02:00
e516d1b19d
fix: Fixed `ruff` configuration to avoid deprecated configuration warning ( #30179 )
...
* Fixed deprecated ruff configuration in pyproject.toml file
* reverted un-necessary changes.
* small fix.
2024-04-11 12:47:10 +01:00
58b170cdb1
chore: remove repetitive words ( #30174 )
...
Signed-off-by: hugehope <cmm7@sina.cn>
2024-04-11 09:49:36 +01:00
e50be9a058
Guard XLA version imports ( #30167 )
2024-04-11 04:49:16 -04:00
fbdb978eb5
Fix Llava chat template examples ( #30130 )
2024-04-11 10:38:24 +02:00
Arthur Zucker