Hugging Face's logo

OuteAI
/
Oute-Dev-0.7B-Checkpoint-40B

Safetensors
phi3
Model card Files Community
Oute-Dev-0.7B-Checkpoint-40B
File size: 2,983 Bytes 
27a1c5a
 
 
 
c8b1275
27a1c5a
6e7f7d9
27a1c5a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bed5fd6
27a1c5a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
 
---
license: apache-2.0
datasets:
- mlfoundations/dclm-baseline-1.0-parquet
- mlfoundations/dclm-baseline-1.0
---

<style>
table {
    border-collapse: collapse;
    width: 100%;
    margin-bottom: 20px;
}
th, td {
    border: 1px solid #ddd;
    padding: 8px;
    text-align: center;
}
.best {
    font-weight: bold;
    text-decoration: underline;
}
</style>

<div style="text-align: center; margin: 20px auto; padding: 20px; border: 3px solid #ddd; border-radius: 10px;">
  <h2 style="margin-bottom: 4px; margin-top: 0px;">OuteAI</h2>
  <a href="https://www.outeai.com/" target="_blank" style="margin-right: 10px;">🌎 OuteAI.com</a> 
  <a href="https://discord.gg/vyBM87kAmf" target="_blank" style="margin-right: 10px;">🤝 Join our Discord</a>
  <a href="https://x.com/OuteAI" target="_blank">𝕏 @OuteAI</a>
</div>

### Experimental Development Models

These development models are designed specifically for **experimental and testing purposes**. 

They have been trained using our pre-trained **BPE tokenizer** with a vocabulary size of 61,440. 

#### Model Details:
- **[Oute-Dev-0.7B-Checkpoint-40B](https://huggingface.co/OuteAI/Oute-Dev-0.7B-Checkpoint-40B)**: Built on the **Phi3 architecture**, trained on approximately **40 billion tokens**.
- **[Oute-Dev-1B-Checkpoint-40B](https://huggingface.co/OuteAI/Oute-Dev-1B-Checkpoint-40B)**: Built on the **LLaMa architecture**, trained on approximately **40 billion tokens**.

> [!IMPORTANT]
> These models were initially developed for internal testing and did not undergo extensive training. The output quality will not be suitable for production use or serious applications. You should expect inconsistent, potentially low-quality outputs.

### Benchmark Performance:

<table>
<tr>
    <th>Benchmark</th>
    <th>Oute-Dev-0.7B-Checkpoint-40B</th>
    <th>Oute-Dev-1B-Checkpoint-40B</th>
</tr>
<tr>
    <td>ARC-C (0-shot)</td>
    <td>28.24</td>
    <td>26.19</td>
</tr>
<tr>
    <td>ARC-E (0-shot)</td>
    <td>55.13</td>
    <td>57.32</td>
</tr>
<tr>
    <td>HellaSWAG (0-shot)</td>
    <td>41.20</td>
    <td>43.70</td>
</tr>
<tr>
    <td>PIQA (0-shot)</td>
    <td>68.39</td>
    <td>69.59</td>
</tr>
<tr>
    <td>Winogrande (0-shot)</td>
    <td>54.14</td>
    <td>50.51</td>
</tr>
</table>

## Disclaimer
By using this model, you acknowledge that you understand and assume the risks associated with its use. 
You are solely responsible for ensuring compliance with all applicable laws and regulations. 
We disclaim any liability for problems arising from the use of this open-source model, including but not limited to direct, indirect, incidental, consequential, or punitive damages. 
We make no warranties, express or implied, regarding the model's performance, accuracy, or fitness for a particular purpose. Your use of this model is at your own risk, and you agree to hold harmless and indemnify us, our affiliates, and our contributors from any claims, damages, or expenses arising from your use of the model.