9740a03f61
Skip broken test
2022-11-10 14:59:32 -05:00
905e5773a3
[processor] Add 'model input names' property ( #20117 )
...
* [processor] Add 'model input names' property
* add test
* no f string
* add generic property method to mixin
* copy to multimodal
* copy to vision
* tests for all audio
* remove ad-hoc tests
* style
* fix flava test
* fix test
* fix processor code
2022-11-10 19:29:20 +00:00
68187c4642
Fix arg names for our models ( #20166 )
...
* Fix arg names for our models
* Clean out the other uses of "residx" in infer()
* make fixup
2022-11-10 16:47:58 +00:00
6dda14dc47
Generate: fix TF doctests ( #20159 )
2022-11-10 15:30:39 +00:00
e0d7c831c7
Update `OnnxConfig.generate_dummy_inputs` to check `ImageProcessingMixin` ( #20157 )
...
* Check ImageProcessingMixin in OnnxConfig.generate_dummy_inputs
* Check ImageProcessingMixin in OnnxConfig.generate_dummy_inputs
* Add back
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-10 16:04:51 +01:00
daf4436e07
doc comment fix: Args was in wrong place ( #20164 )
2022-11-10 10:02:24 -05:00
9f0c72f93b
Add doc tests ( #20158 )
...
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MBP.localdomain>
2022-11-10 15:25:30 +01:00
d066c3731b
Adding support for LayoutLMvX variants for `object-detection`. ( #20143 )
...
* Adding support for LayoutLMvX variants for `object-detection`.
* Revert bogs `layoutlm` feature extractor which does not exist (it was a
V2 model) .
* Updated condition.
* Handling the comments.
2022-11-10 11:33:38 +01:00
7ec1dc8817
Add `RoCBertTokenizer` to `TOKENIZER_MAPPING_NAMES` ( #20141 )
...
* Add RoCBertTokenizer to TOKENIZER_MAPPING_NAMES
* fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-09 20:58:56 +01:00
67b3789133
Make DummyObject more robust ( #20146 )
2022-11-09 12:57:27 -05:00
93e14486d6
[CLIPSeg] Add resources ( #20118 )
...
* Add resource
* Add tag
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-11-09 18:31:22 +01:00
f3d99e49d4
Update VisionEncoderDecoder to use an image processor ( #20137 )
...
* TrOCR processor uses an image processor
* Update VisionEncoderDecoder
* Add feature_extractor_class property
2022-11-09 16:31:05 +00:00
a44985b41c
add cv + audio labels ( #20114 )
2022-11-09 07:40:15 -08:00
f270b960d6
Generate: move generation_*.py src files into generation/*.py ( #20096 )
...
* move generation_*.py src files into generation/*.py
* populate generation.__init__ with lazy loading
* move imports and references from generation.xxx.object to generation.object
2022-11-09 15:34:08 +00:00
bac2d29a80
Attempting to test automatically the `_keys_to_ignore`. ( #20042 )
...
* Attempting to test automatically the `_keys_to_ignore`.
* Style.
* First fix pass.
* Moving test on its own.
* Another batch.
* Second round removing BatchNorm
* Fixing layoutlmv{2,3} + support older Python.
* Disable miss missing warning.
* Removing dodgy additions.
* Big pass.
* mbart.
* More corrections.
* Fixup.
* Updating test_correct_missing_keys
* Add escape hatch for when the head has no extra params so doesn't need
the missing keys check.
* Fixing test.
* Greener.
* Green ! (except for weird splinter bug).
* Adding a test about `named_parameters` usage.
* Shorten message.
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* After rebase modifications.
* More explicit condition checking.
* Fixing slow tests issues.
* Remove extra pdb.
* Remove print.
* Attempt to make failure consistent + fixing roc_bert.
* Removing the seed (all tests passing with it).
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-11-09 16:03:36 +01:00
d606d566ab
Update SwinForMaskedImageModeling doctest values ( #20139 )
...
* Update doctest values
* Update copy statement
2022-11-09 14:53:01 +00:00
c4cad8e301
Update `CLIPSegModelTester` ( #20134 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-09 15:21:52 +01:00
0946ed94fd
Remove BertConfig inheritance from RobertaConfig ( #20124 )
...
* Remove BertConfig inheritance from RobertaConfig
* Fix Typo: BERT to RoBERTa
2022-11-09 08:51:12 -05:00
316bf04d3d
Improve tiny model creation script ( #20119 )
...
* Improve tiny model creation script
* sort the list of models to upload
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-09 11:34:35 +01:00
4eb918e656
AutoImageProcessor ( #20111 )
...
* AutoImageProcessor skeleton
* Update references
* Add mapping in init
* Add model image processors to __init__ for importing
* Add AutoImageProcessor tests
* Fix up
* Image Processor documentation
* Remove pdb
* Update docs/source/en/model_doc/mobilevit.mdx
* Update docs
* Don't add whitespace on json files
* Remove fixtures
* Move checking model config down
* Fix up
* Add check for image processor
* Remove FeatureExtractorMixin in docstrings
* Rename model_tmpfile to config_tmpfile
* Don't make None if not in image processor map
2022-11-08 19:54:41 +00:00
c08a1e26ab
Adapt has_labels test when no labels were found ( #20113 )
...
* Make default labels for non-pretrained models
* Fix the has_labels test instead
2022-11-08 13:53:04 -05:00
e2a23b6ce9
Update github pr docs actions ( #20125 )
2022-11-08 10:37:24 -05:00
2d6a92f22a
Fix repo consistency
2022-11-08 10:04:30 -05:00
efa889d2e4
Add RocBert ( #20013 )
...
* add roc_bert
* update roc_bert readme
* code style
* change name and delete unuse file
* udpate model file
* delete unuse log file
* delete tokenizer fast
* reformat code and change model file path
* add RocBertForPreTraining
* update docs
* delete wrong notes
* fix copies
* fix make repo-consistency error
* fix files are not present in the table of contents error
* change RocBert -> RoCBert
* add doc, add detail test
Co-authored-by: weiweishi <weiweishi@tencent.com>
2022-11-08 10:03:43 -05:00
258963062b
Add CLIPSeg ( #20066 )
...
* Add first draft
* Update conversion script
* Improve conversion script
* Improve conversion script some more
* Add conditional embeddings
* Add initial decoder
* Fix activation function of decoder
* Make decoder outputs match original implementation
* Make decoder outputs match original implementation
* Add more copied from statements
* Improve model outputs
* Fix auto tokenizer file
* Fix more tests
* Add test
* Improve README and docs, improve conditional embeddings
* Fix more tests
* Remove print statements
* Remove initial embeddings
* Improve conversion script
* Add interpolation of position embeddings
* Finish addition of interpolation of position embeddings
* Add support for refined checkpoint
* Fix refined checkpoint
* Remove unused parameter
* Improve conversion script
* Add support for training
* Fix conversion script
* Add CLIPSegFeatureExtractor
* Fix processor
* Fix CLIPSegProcessor
* Fix conversion script
* Fix most tests
* Fix equivalence test
* Fix README
* Add model to doc tests
* Use better variable name
* Convert other checkpoint as well
* Update config, add link to paper
* Add docs
* Update organization
* Replace base_model_prefix with clip
* Fix base_model_prefix
* Fix checkpoint of config
* Fix config checkpoint
* Remove file
* Use logits for output
* Fix tests
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-11-08 10:55:47 +01:00
3e39fd09a9
[Audio Processor] Only pass sr to feat extractor ( #20022 )
...
* [Audio Processor] Only pass sr to feat extractor
* move out of if/else
* copy to other processors
2022-11-08 08:59:03 +00:00
fb1c8db78a
Fix AutoTokenizer with subfolder passed ( #20110 )
2022-11-07 17:59:46 -05:00
6156bffa2b
Replace awkward timm link with the expected one ( #20109 )
2022-11-07 13:57:39 -05:00
71f772ebd0
Add new terms to the glossary ( #20051 )
...
* add new terms
* apply review
2022-11-07 10:45:27 -08:00
d44ac47bac
docs: Fixed variables in f-strings ( #20087 )
...
* docs: Fixed variables in f-strings
* Replace unknown `block` with known `block_type` in ValueError
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Add missing torch import in docs code block
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-11-07 13:18:09 -05:00
2bdd9fa284
Fix `generate_dummy_inputs` for `ImageGPTOnnxConfig` ( #20103 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-07 16:31:26 +01:00
cfaeb1539e
use huggingface_hub.model_inifo() to get pipline_tag ( #20077 )
2022-11-07 10:07:59 -05:00
3222fc645b
docs: Resolve many typos in the English docs ( #20088 )
...
* docs: Fix typo in ONNX parser help: 'tolerence' => 'tolerance'
* docs: Resolve many typos in the English docs
Typos found via 'codespell ./docs/source/en'
2022-11-07 09:19:04 -05:00
b8112eddec
Replace unsupported facebookresearch/bitsandbytes ( #20093 )
...
With https://github.com/TimDettmers/bitsandbytes , which is by the same author and is still being updated
2022-11-07 08:52:03 -05:00
4ab6e9e2f8
Skip 2 tests in `VisionTextDualEncoderProcessorTest` ( #20098 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-07 14:51:05 +01:00
b77406bcb2
Removing RobertaConfig inheritance from CamembertConfig ( #20059 )
...
* swap RobertaConfig with PretrainedConfig
* Add camembert specific attributes
* Add PretrainedConfig docstring
* Add arguments docstring
* Change CamembertConfig docstring definition
* Fix typo CamembertConfig -> CamembertModel
* Fix typo BertModel -> CamembertModel
* Fix style of CamembertConfig
2022-11-07 08:50:10 -05:00
9617b1304e
[Doctest] Add configuration_dpr.py ( #20080 )
...
* Add example docstring for DPRConfig
* Add DPRConfig to documentation_tests
2022-11-07 14:49:59 +01:00
a0f8674303
Generate: TF contrastive search with XLA support ( #20050 )
...
* Add contrastive search
2022-11-07 10:54:29 +00:00
504db92e7d
Update hub.py ( #20075 )
2022-11-04 22:25:02 +01:00
4b86e44693
Update modeling_tf_utils.py ( #20076 )
2022-11-04 22:24:37 +01:00
d68c46026b
Update defaults and logic to match old FE ( #20065 )
...
* Update defaults and logic to match old FE
* Use docker run rest values
2022-11-04 19:14:56 +00:00
c06d555647
Show installed libraries and their versions in GA jobs ( #20069 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-04 18:03:18 +01:00
2d02178e5c
Allow passing arguments to model testers for CLIP-like models ( #20044 )
...
* POC
* For more CLIP-like models
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-04 18:01:41 +01:00
3bd0007e87
Update documentation on seq2seq models with absolute positional embeddings, to be in line with Tips section for BERT and GPT2 ( #20068 )
...
Co-authored-by: jordiclive <jordiclive19@imperial.ac.uk>
2022-11-04 11:32:44 -04:00
6e1c5786dc
Update READMEs for ESMFold and add notebooks ( #20067 )
...
* Update READMEs for ESMFold and add notebooks
* Fix PyCharm formatting
* make fix-copies
2022-11-04 15:10:13 +00:00
707b12a353
change constant torch.tensor to torch.full ( #20061 )
2022-11-04 10:41:56 -04:00
787620e2a2
[Swin] Add Swin SimMIM checkpoints ( #20034 )
...
* Fix Swin
* Remove file
* Update code snippet
* Add copied from to maskformer
* Fix docstring
* Add whole name to replace
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
2022-11-04 15:32:44 +01:00
3936411b9d
PoolformerImageProcessor defaults to match previous FE ( #20048 )
...
* Poolformer image processor defaults to previous FE
* Remove unnecessary math.floor
2022-11-04 13:52:58 +00:00
94e17c456c
[Trainer] Fix model name in push_to_hub ( #20064 )
2022-11-04 13:40:21 +00:00
19067711e7
fix `tokenizer_type` to avoid error when loading checkpoint back ( #20062 )
2022-11-04 19:04:01 +05:30
Sylvain Gugger