File size: 376 Bytes
3419449
 
0472d9a
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
Script for training can be found here: https://github.com/vasudevgupta7/bigbird

```python
from transformers import BigBirdForQuestionAnswering

epoch_0 = "4daa96c5befa9b728c47a77280ef9484377d7791"
revision = epoch_0

model = BigBirdForQuestionAnswering.from_pretrained(model_id, revision=revision)
tokenizer = BigBirdTokenizer.from_pretrained(model_id, revision=revision)
```