dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
transformers/tests
History
Suraj Patil 88ef8893cd
Add caching mechanism to BERT, RoBERTa (#9183) 
* add past_key_values

* add use_cache option

* make mask before cutting ids

* adjust position_ids according to past_key_values

* flatten past_key_values

* fix positional embeds

* fix _reorder_cache

* set use_cache to false when not decoder, fix attention mask init

* add test for caching

* add past_key_values for Roberta

* fix position embeds

* add caching test for roberta

* add doc

* make style

* doc, fix attention mask, test

* small fixes

* adress patrick's comments

* input_ids shouldn't start with pad token

* use_cache only when decoder

* make consistent with bert

* make copies consistent

* add use_cache to encoder

* add past_key_values to tapas attention

* apply suggestions from code review

* make coppies consistent

* add attn mask in tests

* remove copied from longformer

* apply suggestions from code review

* fix bart test

* nit

* simplify model outputs

* fix doc

* fix output ordering
 		2020-12-23 23:01:32 +05:30
..
fixtures Add new run_swag example (#9175) 2020-12-18 14:19:24 -05:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
conftest.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_activations.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_activations_tf.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_benchmark.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_benchmark_tf.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_cli.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_configuration_auto.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_configuration_common.py [PretrainedConfig] Fix save pretrained config for edge case (#7943) 2020-10-22 15:39:01 +02:00
test_data_collator.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_doc_samples.py Fix ignore list behavior in doctests (#8213) 2020-11-02 08:47:37 -05:00
test_file_utils.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_flax_auto.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_generation_beam_search.py Refactoring the generate() function (#6949) 2020-11-03 16:04:22 +01:00
test_generation_logits_process.py Diverse beam search 2 (#9006) 2020-12-09 15:00:37 +01:00
test_generation_utils.py Diverse beam search 2 (#9006) 2020-12-09 15:00:37 +01:00
test_hf_api.py transformers-cli: LFS multipart uploads (> 5GB) (#8663) 2020-12-07 16:38:39 -05:00
test_hf_argparser.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_logging.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_model_card.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_model_output.py Add tests and fix various bugs in ModelOutput (#7073) 2020-09-11 12:01:33 -04:00
test_modeling_albert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_auto.py AutoModelForTableQuestionAnswering (#9154) 2020-12-16 12:14:33 -05:00
test_modeling_bart.py Add caching mechanism to BERT, RoBERTa (#9183) 2020-12-23 23:01:32 +05:30
test_modeling_bert.py Add caching mechanism to BERT, RoBERTa (#9183) 2020-12-23 23:01:32 +05:30
test_modeling_bert_generation.py Add caching mechanism to BERT, RoBERTa (#9183) 2020-12-23 23:01:32 +05:30
test_modeling_blenderbot.py add base model classes to bart subclassed models (#9230) 2020-12-21 19:56:46 +05:30
test_modeling_camembert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_common.py Fixed beam search generation for GPT2 and T5 (#9219) 2020-12-21 08:05:23 -05:00
test_modeling_ctrl.py Ctrl for sequence classification (#8812) 2020-12-01 09:49:27 +01:00
test_modeling_deberta.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_modeling_distilbert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_dpr.py Fix dpr<>bart config for RAG (#8808) 2020-11-27 16:26:45 +01:00
test_modeling_electra.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_encoder_decoder.py [EncoderDecoder] Make tests more aggressive (#9256) 2020-12-22 17:00:04 +01:00
test_modeling_flaubert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_flax_bert.py [Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054) 2020-12-16 13:03:32 +01:00
test_modeling_flax_common.py [Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054) 2020-12-16 13:03:32 +01:00
test_modeling_flax_roberta.py [Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054) 2020-12-16 13:03:32 +01:00
test_modeling_fsmt.py [PyTorch] Refactor Resize Token Embeddings (#8880) 2020-12-02 19:19:50 +01:00
test_modeling_funnel.py Switch `return_dict` to `True` by default. (#8530) 2020-11-16 11:43:00 -05:00
test_modeling_gpt2.py [EncoderDecoder] Make tests more aggressive (#9256) 2020-12-22 17:00:04 +01:00
test_modeling_layoutlm.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_longformer.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_lxmert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_marian.py consistent ignore keys + make private (#8737) 2020-11-23 12:33:13 -08:00
test_modeling_mbart.py add base model classes to bart subclassed models (#9230) 2020-12-21 19:56:46 +05:30
test_modeling_mobilebert.py Removed unused `encoder_hidden_states` and `encoder_attention_mask` (#8972) 2020-12-08 12:04:34 -05:00
test_modeling_mpnet.py Add MP Net 2 (#9004) 2020-12-09 10:32:43 -05:00
test_modeling_mt5.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_openai.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_pegasus.py add base model classes to bart subclassed models (#9230) 2020-12-21 19:56:46 +05:30
test_modeling_prophetnet.py Make ProphetNetModel really compatible with EncoderDecoder (#9033) 2020-12-11 16:59:54 +01:00
test_modeling_rag.py [RAG, Bart] Align RAG, Bart cache with T5 and other models of transformers (#9098) 2020-12-14 12:32:26 +01:00
test_modeling_reformer.py [PyTorch] Refactor Resize Token Embeddings (#8880) 2020-12-02 19:19:50 +01:00
test_modeling_roberta.py Add caching mechanism to BERT, RoBERTa (#9183) 2020-12-23 23:01:32 +05:30
test_modeling_squeezebert.py Switch `return_dict` to `True` by default. (#8530) 2020-11-16 11:43:00 -05:00
test_modeling_t5.py [EncoderDecoder] Make tests more aggressive (#9256) 2020-12-22 17:00:04 +01:00
test_modeling_tapas.py AutoModelForTableQuestionAnswering (#9154) 2020-12-16 12:14:33 -05:00
test_modeling_tf_albert.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_auto.py Optional layers (#8961) 2020-12-08 09:14:09 -05:00
test_modeling_tf_bart.py Model Templates for Seq2Seq (#9251) 2020-12-22 23:41:20 +01:00
test_modeling_tf_bert.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_blenderbot.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_camembert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_common.py Fix tf2.4 (#9120) 2020-12-15 10:10:46 -05:00
test_modeling_tf_ctrl.py Added TF CTRL Sequence Classification (#9151) 2020-12-17 18:10:57 -05:00
test_modeling_tf_distilbert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_dpr.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_electra.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_flaubert.py Switch `return_dict` to `True` by default. (#8530) 2020-11-16 11:43:00 -05:00
test_modeling_tf_funnel.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_modeling_tf_gpt2.py [EncoderDecoder] Make tests more aggressive (#9256) 2020-12-22 17:00:04 +01:00
test_modeling_tf_longformer.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_lxmert.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_marian.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_mbart.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_mobilebert.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_mpnet.py Add MP Net 2 (#9004) 2020-12-09 10:32:43 -05:00
test_modeling_tf_mt5.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_openai.py Added TF OpenAi GPT1 Sequence Classification (#9105) 2020-12-15 11:27:08 -05:00
test_modeling_tf_pegasus.py Fix embeddings resizing in TF models (#8657) 2020-12-13 23:05:24 -05:00
test_modeling_tf_pytorch.py Optional layers (#8961) 2020-12-08 09:14:09 -05:00
test_modeling_tf_roberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_t5.py [EncoderDecoder] Make tests more aggressive (#9256) 2020-12-22 17:00:04 +01:00
test_modeling_tf_transfo_xl.py Added TF TransfoXL Sequence Classification (#9169) 2020-12-19 14:44:04 +01:00
test_modeling_tf_xlm.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_xlm_roberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_tf_xlnet.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_transfo_xl.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_xlm.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_xlm_prophetnet.py Ci test tf super slow (#8007) 2020-10-30 10:25:48 -04:00
test_modeling_xlm_roberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_modeling_xlnet.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_onnx.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_optimization.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_optimization_tf.py Fix tf2.4 (#9120) 2020-12-15 10:10:46 -05:00
test_pipelines_common.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_conversational.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_feature_extraction.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_fill_mask.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_ner.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_question_answering.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_sentiment_analysis.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_summarization.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_table_question_answering.py TableQuestionAnsweringPipeline (#9145) 2020-12-16 12:31:50 -05:00
test_pipelines_text2text_generation.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_text_generation.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_translation.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_pipelines_zero_shot.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_retrieval_rag.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_skip_decorators.py [testing] rename skip targets + docs (#7863) 2020-10-20 04:39:13 -04:00
test_tokenization_albert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_auto.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_bart.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_barthez.py Add barthez model (#8393) 2020-11-27 12:31:42 -05:00
test_tokenization_bert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_bert_generation.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_bert_japanese.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_bertweet.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_blenderbot.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_camembert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_common.py [WIP] Tapas v4 (tres) (#9117) 2020-12-15 17:08:49 -05:00
test_tokenization_ctrl.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_deberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_distilbert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_dpr.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_fsmt.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_funnel.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_gpt2.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_herbert.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_layoutlm.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_lxmert.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_marian.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_mbart.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_mpnet.py [MPNet] Add slow to fast tokenizer converter (#9233) 2020-12-21 15:41:34 +01:00
test_tokenization_openai.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_pegasus.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_phobert.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_prophetnet.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_rag.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_reformer.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_roberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_squeezebert.py [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
test_tokenization_t5.py fix t5 token type ids (#8437) 2020-11-10 14:21:54 -05:00
test_tokenization_tapas.py [WIP] Tapas v4 (tres) (#9117) 2020-12-15 17:08:49 -05:00
test_tokenization_transfo_xl.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_utils.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_xlm.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_xlm_prophetnet.py Reorganize repo (#8580) 2020-11-16 21:43:42 -05:00
test_tokenization_xlm_roberta.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_tokenization_xlnet.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_trainer.py Add timing inside Trainer (#9196) 2020-12-18 15:10:39 -05:00
test_trainer_callback.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_trainer_distributed.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_trainer_seq2seq.py Seq2seq trainer (#9241) 2020-12-22 11:33:44 -05:00
test_trainer_tpu.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_trainer_utils.py Seq2seq trainer (#9241) 2020-12-22 11:33:44 -05:00
test_utils_check_copies.py Copyright (#8970) 2020-12-07 18:36:34 -05:00
test_versions_utils.py Copyright (#8970) 2020-12-07 18:36:34 -05:00