dnrops
/
transformers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

TF Flaubert w/ pre-norm (#6841)

This commit is contained in:
Lysandre Debut 2020-08-31 10:53:20 +02:00 committed by GitHub
parent 4561f05c5f
commit 895d394669
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/modeling_tf_flaubert.py
View File

@ -296,7 +296,7 @@ class TFFlaubertMainLayer(TFXLMMainLayer):
else:
tensor_normalized = self.layer_norm1[i](tensor)
attn_outputs = self.attentions[i](
tensor_normalized, attn_mask, None, cache, head_mask[i], training=training
tensor_normalized, attn_mask, None, cache, head_mask[i], output_attentions, training=training
)
attn = attn_outputs[0]
if output_attentions: