6a3c883c8b
Fix PR number ( #15231 )
...
* Fix PR number
* Fix PR number
2022-01-19 11:00:16 -05:00
653379c094
Build dev documentation ( #15210 )
...
* Wrap up
* Remove secret
* Fix path
* Typo
Revert image switch
* Specific token for comments
* Cleaner comments
* Correct PR number
* Explicit master install
* Force uninstall
2022-01-19 08:47:34 -05:00
5f3c57fc84
Check the repo consistency in model templates test ( #15141 )
...
* Check the repo consistency in model templates test
* Fix doc template
* Fix docstrings
* Fix last docstring
2022-01-14 04:52:38 -05:00
6950ccec1b
doc-builder -> doc-build ( #15134 )
...
* Updated script
* Commit everything
* Ready for review!
* Update .github/workflows/build_documentation.yml
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
2022-01-13 06:02:24 -05:00
444ea95a80
Print out durations of all scheduled tests ( #15102 )
2022-01-11 08:15:59 -05:00
42d57549b8
Change assignee for tokenizers ( #15088 )
2022-01-10 09:22:48 -05:00
83c552d390
Add detectron2 to Github actions ( #15053 )
2022-01-06 08:53:58 -05:00
dbac8899fe
[Tests] Correct Wav2Vec2 & WavLM tests ( #15015 )
...
* up
* up
* up
2022-01-03 20:19:04 +01:00
c075fb7855
Replace commit sha by commit url for update jobs ( #14852 )
...
* Replace commit sha by commit url for update jobs
* Typo
* Update .github/workflows/build_documentation.yml
Co-authored-by: Julien Chaumond <julien@huggingface.co>
* Apply review comments
Co-authored-by: Julien Chaumond <julien@huggingface.co>
2021-12-21 11:17:11 -05:00
c4a96cecbc
Wav2Vec2 meets phonemes ( #14353 )
...
* up
* add tokenizer
* improve more
* finish tokenizer
* finish
* adapt speech recognition script
* adapt convert
* more fixes
* more fixes
* update phonemizer wav2vec2
* better naming
* fix more tests
* more fixes swedish
* correct tests
* finish
* improve script
* remove file
* up
* lets get those 100 model architectures until the end of the month
* make fix-copies
* correct more
* correct script
* more fixes
* more fixes
* add to docs
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* replace assert
* fix copies
* fix docs
* new try docs
* boom boom
* update
* add phonemizer to audio tests
* make fix-copies
* up
* upload models
* some changes
* Update tests/test_tokenization_wav2vec2_phoneme.py
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
* more fixes
* remove @
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
2021-12-17 19:56:44 +01:00
12e1b4c6df
Fix the build documentation job ( #14788 )
...
* Fix the build documentation job
* Fix install
* Address review comment
2021-12-16 09:35:20 -05:00
7e61d56a45
Fix the doc_build_test job ( #14774 )
...
* Fake new model
* Fix doc-building test job
* Is this the problem?
* Another try
* Typo
* Clean up
* Can we do without -e ?
* Clean setup
2021-12-15 03:40:17 -05:00
7533d30acd
Convert Trainer doc page to MarkDown ( #14753 )
...
* Convert Trainer doc page to MarkDown
* Fix repo consistency
* Fix the doc build test job
2021-12-13 13:09:50 -05:00
e4666bff06
Fix name
2021-12-13 12:01:37 -05:00
64e92ed224
Update transformers metadata ( #14724 )
...
* Wip on metadata update
* Most of the script
* Add a job to auto-update the transformers metadata
* Style
2021-12-13 11:46:03 -05:00
c3cd88a9ba
Small fixes for the doc ( #14751 )
2021-12-13 11:17:01 -05:00
8362d07d63
[CI/pt-nightly] switch to cuda-11.3 ( #14726 )
2021-12-13 09:53:48 -05:00
86dd23bb8b
Update bug-report.md ( #14715 )
2021-12-12 13:30:44 +01:00
f46668282b
Fix path for notebooks
2021-12-10 15:03:17 -05:00
3b2d1652e4
Fix typo in branch name
2021-12-10 14:38:21 -05:00
1b75d7238c
Automatically build doc notebooks ( #14718 )
...
* Test workflow
* Build doc
* Make a clean build
* Add doc config
* Restore other workflows
* Final job
* Print something in else statements
* Pull before making changes
2021-12-10 14:20:56 -05:00
68e53e6fcd
Add a job to test doc building (for realsies this time) ( #14662 )
2021-12-09 07:01:03 -05:00
2294071a0c
Fix doc builder ( #14676 )
2021-12-08 09:14:36 -05:00
961732c276
[Wav2Vec2] PyCTCDecode Integration to support language model boosted decoding ( #14339 )
...
* up
* up
* up
* make it cleaner
* correct
* make styhahalal
* add more tests
* finish
* small fix
* make style
* up
* tryout to solve cicrle ci
* up
* fix more tests
* fix more tests
* apply sylvains suggestions
* fix import
* correct docs
* add pyctcdecode only to speech tests
* fix more tests
* add tf, flax and pt tests
* add pt
* fix last tests
* fix more tests
* Apply suggestions from code review
* change lines
* Apply suggestions from code review
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
* correct tests
* correct tests
* add doc string
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
2021-12-08 12:07:54 +01:00
381b05a3f5
Remove nonworking workflow for now
2021-12-06 17:25:28 -05:00
03fda7b743
Add a job to test the documentation build ( #14645 )
...
* Add a job to the documentation build
* Add caching
* Test cache
2021-12-06 13:55:59 -05:00
aada989ad5
Fix doc builder ( #14616 )
...
* Fix doc builder
* Fix doc builder
* Fix doc builder
2021-12-03 12:09:25 -05:00
e62091d5a7
[CI] move env print to util, add pt, nccl versions ( #14607 )
...
* move env print to util, add pt, nccl versions
* style
* version
* align
2021-12-03 08:18:36 -05:00
77d87e732e
Adds a git pull instruction to the documentation builder ( #14597 )
...
* Adds a git pull instruction
* master -> main
2021-12-02 03:32:38 -05:00
4df7d05a87
Doc new front ( #14590 )
...
* Convert PretrainedConfig doc to Markdown
* Use syntax
* Add necessary doc files (#14496 )
* Doc fixes (#14499 )
* Fixes for the new front
* Convert DETR file for table
* Title is needed
* Simplify a bit
* Even simpler
* Remove imports
* Fix typo in toctree (#14516 )
* Fix checkpoints badge
* Update versions.yml format (#14517 )
* Doc new front github actions (#14512 )
* Doc new front github actions
* Fix docstring
* Fix feature extraction utils import (#14515 )
* Address Julien's comments
* Push to doc-builder
* Ready for merge
* Remove old build and deploy
* Doc misc fixes (#14583 )
* Rm versions.yml from doc
* Fix converting.rst
* Rm pretrained_models from toctree
* Fix index links (#14567 )
* Fix links in README
* Localized READMEs
* Fix copy script
* Fix find doc script
* Update README_ko.md
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
* Adapt build command to new CLI tools (#14578 )
* Fix typo
* Fix doc interlinks (#14589 )
* Convert PretrainedConfig doc to Markdown
* Use syntax
* Rm pattern <[a-z]+(.html).*>
* Rm huggingface.co/transformers/master
* Rm .html
* Rm .html from index.mdx
* Rm .html from model_summary.rst
* Update index.mdx rm html
* Update remove .html
* Fix inner doc links
* Fix interlink in preprocssing.rst
* Update pr_checks
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Convert PretrainedConfig doc to Markdown
* Use syntax
* Add necessary doc files (#14496 )
* Doc fixes (#14499 )
* Fixes for the new front
* Convert DETR file for table
* Title is needed
* Simplify a bit
* Even simpler
* Remove imports
* Fix checkpoints badge
* Fix typo in toctree (#14516 )
* Update versions.yml format (#14517 )
* Doc new front github actions (#14512 )
* Doc new front github actions
* Fix docstring
* Fix feature extraction utils import (#14515 )
* Address Julien's comments
* Push to doc-builder
* Ready for merge
* Remove old build and deploy
* Doc misc fixes (#14583 )
* Rm versions.yml from doc
* Fix converting.rst
* Rm pretrained_models from toctree
* Fix index links (#14567 )
* Fix links in README
* Localized READMEs
* Fix copy script
* Fix find doc script
* Update README_ko.md
Co-authored-by: Julien Chaumond <julien@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
* Adapt build command to new CLI tools (#14578 )
* Fix typo
* Fix doc interlinks (#14589 )
* Convert PretrainedConfig doc to Markdown
* Use syntax
* Rm pattern <[a-z]+(.html).*>
* Rm huggingface.co/transformers/master
* Rm .html
* Rm .html from index.mdx
* Rm .html from model_summary.rst
* Update index.mdx rm html
* Update remove .html
* Fix inner doc links
* Fix interlink in preprocssing.rst
* Update pr_checks
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Styling
Co-authored-by: Mishig Davaadorj <mishig.davaadorj@coloradocollege.edu>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Julien Chaumond <julien@huggingface.co>
2021-12-01 14:13:02 -05:00
d1fd64e7aa
clear ~/.cache/torch_extensions between builds ( #14520 )
2021-11-25 03:15:35 -05:00
3772af49ce
[Tests] Improve vision tests ( #14458 )
...
* Improve tests
* Install vision for tf tests
2021-11-24 15:22:20 +01:00
01b1466983
[TPU tests] Enable first TPU examples pytorch ( #14121 )
...
* up
* up
* fix
* up
* Update examples/pytorch/test_xla_examples.py
* correct labels
* up
* up
* up
* up
* up
* up
2021-10-28 01:22:28 +02:00
990de2c17c
Remove pip 21.3 from installation candidates for model templates
2021-10-11 23:21:37 -04:00
239bd61b99
Update bug-report.md ( #13934 )
...
* Update bug-report.md
* Update .github/ISSUE_TEMPLATE/bug-report.md
Co-authored-by: Suraj Patil <surajp815@gmail.com>
* Update .github/ISSUE_TEMPLATE/bug-report.md
Co-authored-by: Suraj Patil <surajp815@gmail.com>
* Update .github/ISSUE_TEMPLATE/bug-report.md
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* Update .github/ISSUE_TEMPLATE/bug-report.md
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
2021-10-08 14:41:51 -04:00
6a3a197fcd
Add SigOpt HPO to transformers trainer api ( #13572 )
...
* add sigopt hpo to transformers.
Signed-off-by: Ding, Ke <ke.ding@intel.com>
* extend sigopt changes to test code and others..
Signed-off-by: Ding, Ke <ke.ding@intel.com>
* Style.
* fix style for sigopt integration.
Signed-off-by: Ding, Ke <ke.ding@intel.com>
* Add necessary information to run unittests on SigOpt.
Co-authored-by: Morgan Funtowicz <funtowiczmo@gmail.com>
2021-09-23 17:01:51 +02:00
89da1bfeac
[ci] nightly: add deepspeed master ( #13589 )
2021-09-15 20:18:34 -04:00
9f318be3d3
Fix yml syntax error
2021-09-14 11:31:17 -04:00
3ab0185b06
Nightly torch ci ( #13550 )
...
* Nightly CI torch
* Version
* Reformat
* Only subset
Fix
* Revert
* Better formatting
* New channel
2021-09-13 16:17:29 -04:00
f8363e49f9
Install libsndfile ( #13403 )
2021-09-06 17:12:43 -04:00
d160782a53
Add template for adding flax models ( #12441 )
...
* Add option to add flax
* Add flax template for __init__.py
* Add flax template for .rst
* Copy TF modeling template
* Add a missing line in modeling_tf_... template
* Update first half of modeling_flax_..
* Update encoder flax template
* Copy test_modeling_tf... as test_modeling_flax...
* Replace some TF to Flax in test_modeling_flax_...
* Replace tf to np
some function might not work, like _assert_tensors_equal
* Replace remaining tf to np (might not work)
* Fix cookiecutter
* Add Flax in to_replace_... template
* Update transformers-cli add-new-model
* Save generate_flax in configuration.json
This will be read by transformers-cli
* Fix to_replace_... and cli
* Fix replace cli
* Fix cookiecutter name
* Move docstring earlier to avoid not defined error
* Fix a missing Module
* Add encoder-decoder flax template from bart
* Fix flax test
* Make style
* Fix endif
* Fix replace all "utf-8 -> unp-8"
* Update comment
* Fix flax template (add missing ..._DOCSTRING)
* Use flax_bart imports in template (was t5)
* Fix unp
* Update templates/adding_a_new_model/tests
* Revert "Fix unp"
This reverts commit dc9002a41d
2021-09-01 09:49:03 +02:00
8e20887886
Update self-push.yml ( #13364 )
2021-09-01 03:37:51 -04:00
642e1936e3
[GitHub Runner] Fix flax runner ( #13357 )
...
* correct
* also comment out multi-gpu test push
2021-08-31 09:01:35 -04:00
aa08a34669
[Flax tests] NVIDIA-SMI failure should continue
2021-08-31 14:18:20 +02:00
062300ba7f
[Testing] Add Flax Tests on GPU, Add Speech and Vision to Flax & TF tests ( #13313 )
...
* up
* finish
* Apply suggestions from code review
* apply Lysandres suggestions
* adapt circle ci as well
* finish
* Update setup.py
2021-08-31 11:08:22 +02:00
3bb4466260
Better notification service ( #13267 )
2021-08-25 12:14:44 -04:00
e2f07c01e9
Ci continue through smi failure ( #13140 )
...
* Continue on error
* Specific
* Temporary patch
2021-08-16 11:40:38 -04:00
b9962b8656
Ci last fix ( #13103 )
...
* Only report failures on failures
* Fix typo
* Put it everywhere
2021-08-12 10:45:06 -04:00
be323d5152
Reactive test fecthers on scheduled test with proper git install ( #13097 )
...
* Reactive test fecthers on scheduled test with proper git install
* Proper fetch-depth
2021-08-12 11:38:14 +02:00
53b38d6269
Doctests job ( #13088 )
...
* Doctests
* Limit to 4 decimals
* Try with separate PT/TF tests
* Remove test for TF
* Ellips the predictions
* Doctest continue on failure
Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
2021-08-12 03:42:25 -04:00
Lysandre Debut