File size: 770 Bytes
c4447ed
 
 
c843477
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
---

license: apache-2.0
---


Each directory corresponds to a model/datapoint in the InterpBench dataset. It is structured as: 

```

- task // directory name

-- ll_model_{weight}.pth // the low level transformer model

-- meta.json //ll_model_cfg_{weight}.pkl // a config for the transformer model

-- meta_{weight}.json // training hyperparams

-- edges.pkl // label for the circuit, i.e., list of all the edges that are a part of the ground truth circuit 

```

This repository of models is complimentary to [CircuitsBenchmark](https://github.com/FlyingPumba/circuits-benchmark), and should be used to load the models. Alternatively, [TransformerLens](https://github.com/TransformerLensOrg/TransformerLens) can also be used to load it using the ll_config.json