dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
transformers/examples/research_projects
History
Patrick von Platen 0234de8418
Add Fine-Tuning for Wav2Vec2 (#10145) 
* add encode labels function to tokenizer

* start adding finetuning

* init dropout

* upload

* correct convert script

* apply changes

* fix second typo

* make first dummy training run

* adapt convert script

* push confg for comparison

* remove conf

* finish training

* adapt data collator

* add research folder

* update according to fairseq feedback

* some minor corrections

* refactor masking indices a bit

* some minor changes

* clean tokenizer

* finish clean-up

* remove previous logic

* update run script

* correct training

* finish changes

* finish model

* correct bug

* fix training a bit more

* add some tests

* finish gradient checkpointing

* finish example

* correct gradient checkpointing

* improve tokenization method

* revert changes in tokenizer

* revert general change

* adapt fine-tuning

* update

* save intermediate test

* Update README.md

* finish finetuning

* delete conversion script

* Update src/transformers/models/wav2vec2/configuration_wav2vec2.py

* Update src/transformers/models/wav2vec2/processing_wav2vec2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* finish wav2vec2 script

* finish wav2vec2 fine-tuning

* finalize test

* correct test

* adapt tests

* finish

* remove test file

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 		2021-03-01 12:13:17 +03:00
..
adversarial Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bert-loses-patience Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertabs Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
bertology Line endings should be LF across repo and not CRLF (#10119) 2021-02-10 10:50:00 -05:00
deebert Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
distillation Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
longform-qa Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
lxmert [research proj] [lxmert] rm bleach dependency (#9970) 2021-02-03 05:24:40 -05:00
mlm_wwm Fit chinese wwm to new datasets (#9887) 2021-02-01 03:37:59 -05:00
mm-imdb Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
movement-pruning Remove nested lxmert (#9440) 2021-01-07 04:10:41 -05:00
performer Adding performer fine-tuning research exampke (#9239) 2020-12-21 21:19:41 +01:00
pplm Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00
rag Fix typos in README and bugs in RAG example code for end-to-end evaluation and finetuning (#9355) 2021-01-03 16:00:30 +01:00
seq2seq-distillation [PyTorch Bart] Split Bart into different models (#9343) 2021-01-05 22:00:05 +01:00
wav2vec2 Add Fine-Tuning for Wav2Vec2 (#10145) 2021-03-01 12:13:17 +03:00
zero-shot-distillation Zero shot distillation script cuda patch (#10284) 2021-02-19 14:06:57 -05:00
README.md Reorganize examples (#9010) 2020-12-11 10:07:02 -05:00

README.md

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.