rrivera1849 commited on
Commit
b8ec044
·
1 Parent(s): 7255cd4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -46,6 +46,10 @@ print(tokenized_text["attention_mask"].size()) # torch.Size([3, 16, 32])
46
 
47
  out = model(**tokenized_text)
48
  print(out.size()) # torch.Size([3, 512])
 
 
 
 
49
  ```
50
 
51
  ## Citing & Authors
 
46
 
47
  out = model(**tokenized_text)
48
  print(out.size()) # torch.Size([3, 512])
49
+
50
+ # to get the Transformer attentions:
51
+ out, attentions = model(**tokenized_text, output_attentions=True)
52
+ print(attentions[0].size()) # torch.Size([48, 12, 32, 32])
53
  ```
54
 
55
  ## Citing & Authors