5 Commits

Author	SHA1	Message	Date
Daniel Stancl	71bdc076dd	Add head_mask and decoder_head_mask to PyTorch LED (#9856) ... * Add {decoder_,}head_mask to LED * Fix create_custom_forward signatue in encoder * Add head_mask to longformer * Add head_mask to longformer to fix dependencies of LED on Longformer. * Not working yet * Add mising one input in longofrmer_modeling.py * make fix-copies	2021-02-02 11:06:52 -08:00
Patrick von Platen	c8ea582ed6	reduce led memory (#9723)	2021-01-21 05:16:15 -05:00
Patrick von Platen	a400fe8931	[LED Test] fix common inputs pt for flaky pt-tf led test (#9459) ... * fix common inputs pt flakey led * fix other tests correspondingly	2021-01-07 12:29:03 +01:00
Patrick von Platen	b8462b5b2a	[GenerationOutputs] Fix GenerationOutputs Tests (#9443) ... * fix generation models * fix led * fix docs * add is_decoder * fix last docstrings * make style * fix t5 cross attentions * correct t5	2021-01-06 19:37:02 +01:00
Patrick von Platen	189387e9b2	LED (#9278) ... * create model * add integration * save current state * make integration tests pass * add one more test * add explanation to tests * remove from bart * add padding * remove unnecessary test * make all tests pass * re-add cookie cutter tests * finish PyTorch * fix attention test * Update tests/test_modeling_common.py * revert change * remove unused file * add string to doc * save intermediate * make tf integration tests pass * finish tf * fix doc * fix docs again * add led to doctree * add to auto tokenizer * added tips for led * make style * apply jplus statements * correct tf longformer * apply lysandres suggestions * apply sylvains suggestions * Apply suggestions from code review	2021-01-05 13:14:30 +01:00