File size: 437 Bytes
d31427a
 
 
66d7900
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
license: llama2
---

# Code Llama 13B with End-of-turn (EOT) Token

This is the Code Llama 13B model with `<|end_of_turn|>` token added as id `32016` and other special tokens. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.

## Special tokens added:

```json
{
  "<|end_of_turn|>": 32016,
  "<|verdict|>": 32017,
  "<|PAD|>": 32018,
  "<|PAD2|>": 32019,
}
```