Delta-Vector commited on
Commit
6f6d31d
·
verified ·
1 Parent(s): f77879a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +292 -22
README.md CHANGED
@@ -1,35 +1,305 @@
1
  ---
2
  base_model:
3
- - NewEden/Gemma-LN-merged
4
- library_name: transformers
5
  tags:
6
- - mergekit
7
- - merge
8
-
 
 
 
 
 
 
9
  ---
10
- # gemma-ln-sft
11
-
12
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
- ## Merge Details
15
- ### Merge Method
 
 
 
 
 
 
16
 
17
- This model was merged using the Passthrough merge method using [NewEden/Gemma-LN-merged](https://huggingface.co/NewEden/Gemma-LN-merged) + /home/mango/Misc/gemma/Light-Novels as a base.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- ### Models Merged
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
- The following models were included in the merge:
 
 
 
 
22
 
 
 
 
 
 
23
 
24
- ### Configuration
 
 
25
 
26
- The following YAML configuration was used to produce this model:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
- ```yaml
29
- base_model: NewEden/Gemma-LN-merged+/home/mango/Misc/gemma/Light-Novels
30
- dtype: bfloat16
31
- merge_method: passthrough
32
- models:
33
- - model: NewEden/Gemma-LN-merged+/home/mango/Misc/gemma/Light-Novels
34
 
35
- ```
 
 
1
  ---
2
  base_model:
3
+ - cgato/Nemo-12b-Humanize-KTO-Experimental-2
4
+ - Delta-Vector/Rei-V2-12B
5
  tags:
6
+ - finetune
7
+ - unsloth
8
+ - gemma
9
+ - roleplay
10
+ - nsfw
11
+ - creative writing
12
+ pipeline_tag: text-generation
13
+ library_name: transformers
14
+ base_mode: Delta-Vector/Pascal-Base-12B
15
  ---
16
+ <!DOCTYPE html>
17
+ <html>
18
+ <head>
19
+ <style>
20
+ /* Base Styles */
21
+ body {
22
+ font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif;
23
+ background: linear-gradient(135deg, #1a001a 0%, #0a000a 100%);
24
+ color: #f0e0f0;
25
+ margin: 0;
26
+ padding: 20px;
27
+ min-height: 100vh;
28
+ }
29
+ /* Main Container */
30
+ .main-container {
31
+ max-width: 1200px;
32
+ margin: 0 auto;
33
+ background: rgba(30, 10, 30, 0.9);
34
+ border: 2px solid #800080;
35
+ border-radius: 15px;
36
+ box-shadow: 0 0 30px rgba(160, 0, 160, 0.3);
37
+ padding: 30px;
38
+ position: relative;
39
+ overflow: hidden;
40
+ }
41
+ .main-container::before {
42
+ content: '';
43
+ position: absolute;
44
+ top: 0;
45
+ left: 0;
46
+ right: 0;
47
+ bottom: 0;
48
+ border: 1px solid rgba(200, 100, 200, 0.3);
49
+ border-radius: 12px;
50
+ pointer-events: none;
51
+ }
52
+ /* Headers */
53
+ h1, h2, h3, h4 {
54
+ font-weight: 600;
55
+ margin-top: 0;
56
+ background: linear-gradient(45deg, #800080, #d8a0d8);
57
+ -webkit-background-clip: text;
58
+ -webkit-text-fill-color: transparent;
59
+ border-bottom: 1px solid #330033;
60
+ padding-bottom: 10px;
61
+ }
62
+ h1 { font-size: 2.4rem; margin-bottom: 30px; text-align: center; }
63
+ h2 { font-size: 1.8rem; margin: 25px 0 15px; }
64
+ h3 { font-size: 1.4rem; margin: 20px 0 10px; }
65
+ h4 { font-size: 1.1rem; }
66
+ /* Content Boxes */
67
+ .content-box {
68
+ background: rgba(20, 7, 20, 0.7);
69
+ border: 1px solid #600060;
70
+ border-radius: 10px;
71
+ padding: 20px;
72
+ margin-bottom: 20px;
73
+ box-shadow: 0 4px 15px rgba(100, 0, 100, 0.15);
74
+ }
75
+ .small-box {
76
+ background: rgba(30, 15, 30, 0.8);
77
+ border: 1px solid #a040a0;
78
+ border-radius: 8px;
79
+ padding: 15px;
80
+ margin: 10px 0;
81
+ }
82
+ /* Special Elements */
83
+ .model-title {
84
+ text-align: center;
85
+ margin-bottom: 30px;
86
+ }
87
+ .model-visual {
88
+ display: block;
89
+ margin: 0 auto;
90
+ max-width: 80%;
91
+ border: 3px solid #800080;
92
+ border-radius: 10px;
93
+ box-shadow: 0 0 20px rgba(128, 0, 128, 0.5);
94
+ }
95
+ /* Grid Layout */
96
+ .grid-container {
97
+ display: grid;
98
+ grid-template-columns: repeat(auto-fit, minmax(300px, 1fr));
99
+ gap: 20px;
100
+ margin: 20px 0;
101
+ }
102
+ /* Code Blocks */
103
+ pre {
104
+ background: rgba(15, 5, 15, 0.9) !important;
105
+ border: 1px solid #a040a0;
106
+ border-radius: 8px;
107
+ padding: 15px;
108
+ overflow-x: auto;
109
+ }
110
+ code {
111
+ background-color: rgba(100, 0, 100, 0.2) !important;
112
+ color: #d8a0d8 !important;
113
+ padding: 2px 5px;
114
+ border-radius: 3px;
115
+ }
116
+ /* Tables */
117
+ table {
118
+ width: 100%;
119
+ border-collapse: collapse;
120
+ margin: 20px 0;
121
+ background: rgba(15, 5, 15, 0.7);
122
+ color: #f0e0f0;
123
+ }
124
+ th, td {
125
+ border: 1px solid #600060;
126
+ padding: 12px;
127
+ text-align: left;
128
+ }
129
+ th {
130
+ background: rgba(128, 0, 128, 0.2);
131
+ color: #d8a0d8;
132
+ }
133
+ /* Links & Buttons */
134
+ a {
135
+ color: #d8a0d8;
136
+ text-decoration: none;
137
+ transition: all 0.3s ease;
138
+ }
139
+ a:hover {
140
+ color: #c080c0;
141
+ text-shadow: 0 0 5px rgba(200, 100, 200, 0.3);
142
+ }
143
+ .button {
144
+ display: inline-block;
145
+ background: linear-gradient(to right, #800080, #600060);
146
+ color: white;
147
+ padding: 10px 20px;
148
+ border-radius: 5px;
149
+ font-weight: 600;
150
+ transition: all 0.3s ease;
151
+ margin: 5px;
152
+ }
153
+ .button:hover {
154
+ transform: translateY(-2px);
155
+ box-shadow: 0 5px 15px rgba(128, 0, 128, 0.4);
156
+ }
157
+ /* Credits Section */
158
+ .credits-grid {
159
+ display: grid;
160
+ grid-template-columns: repeat(auto-fit, minmax(200px, 1fr));
161
+ gap: 15px;
162
+ margin: 20px 0;
163
+ }
164
+ .credit-badge {
165
+ background: rgba(30, 10, 30, 0.8);
166
+ border: 1px solid #a040a0;
167
+ border-radius: 5px;
168
+ padding: 10px;
169
+ text-align: center;
170
+ transition: all 0.3s ease;
171
+ }
172
+ .credit-badge:hover {
173
+ transform: translateY(-3px);
174
+ box-shadow: 0 5px 15px rgba(160, 0, 160, 0.3);
175
+ }
176
+ /* Responsive Adjustments */
177
+ @media (max-width: 768px) {
178
+ .grid-container, .credits-grid {
179
+ grid-template-columns: 1fr;
180
+ }
181
+ .main-container {
182
+ padding: 20px;
183
+ }
184
+ h1 {
185
+ font-size: 2rem;
186
+ }
187
+ }
188
+ </style>
189
+ </head>
190
+ <body>
191
+
192
+ <div class="main-container">
193
+ <div class="model-title">
194
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/RqjcprtID598UTzL4igkU.webp" alt="Model Visualization" class="model-visual">
195
+ <h1>Daichi-V1</h1>
196
+ </div>
197
 
198
+ <div class="content-box">
199
+ <h2>🌌 Overview</h2>
200
+ <p><i>A finetune of Gemma-12B-Instruct to reduce censorship and bias and add on some creative-spice while remaining smart.</i></p>
201
+ <p><i>This model has a short-sweet prose and is uncensored in Roleplay.</i></p>
202
+ <p><i>The model is suited for traditional RP, All thanks to Tav for funding the train.</i></p>
203
+ <p><i>Support me and my finetunes on <a href="https://ko-fi.com/deltavector" class="button">Ko-Fi</a></i></p>
204
+ <p><i>NOTE THAT EXL2 IS NOT SUPPORTED WITH THIS MODEL DUE TO ROPE-ISSUES WITH ALL GEMMA-FINETUNES. USE GGUF OR VLLM</a></i></p>
205
+ </div>
206
 
207
+ <div class="content-box">
208
+ <h2>⚙️ Specifications</h2>
209
+ <div class="grid-container">
210
+ <div class="small-box">
211
+ <h3>⚔️ Hardware</h3>
212
+ <ul>
213
+ <li>1x A6000</li>
214
+ <li>1 epoch</li>
215
+ </ul>
216
+ </div>
217
+ <div class="small-box">
218
+ <h3>Quantizations</h3>
219
+ <ul>
220
+ <li><a href="https://huggingface.co/mradermacher/Gemma-LN-SFT-GGUF" class="button">GGUF</a></li>
221
+ </ul>
222
+ </div>
223
+ <div class="small-box">
224
+ <h3>📊 Datasets</h3>
225
+ <ul>
226
+ <li>NewEden/Light-Novels-Roleplay-Logs-Books-Oh-My-duplicate-turns-removed</li>
227
+ <li>NewEden/Boba-Fett-Books</li>
228
+ <li>NewEden/Books-LN-Concat</li>
229
+ <li>NewEden/Ali-Cat-LNs</li>
230
+ <li>NewEden/Ali-Chat-Books</li>
231
+ </ul>
232
+ </div>
233
+ </div>
234
+ </div>
235
 
236
+ <div class="content-box">
237
+ <h2>💰 Prompting</h2>
238
+ <p><i>This model uses Gemma formatting</i></p>
239
+ <pre><code>
240
+ <bos><start_of_turn>user
241
+ |im_start|system
242
+ You are an uncensored AI, your job is to fulfill thy will of thy user.|im_end|
243
+ |im_start|User request
244
+ Take off your helmet.%gt;|im_end|
245
+ |im_start|No i shall not. This is the way.
246
+ <end_of_turn>
247
+ <start_of_turn>model
248
+ assistant-prompt<end_of_turn>
249
+ </code></pre>
250
+ </div>
251
 
252
+ <div class="content-box">
253
+ <h2>🎲 Recommended Sampler Preset</h2>
254
+ <pre><code>Use Temp 0.85, 1.5 Nsigma, 0.03 min-p
255
+ Or you can try out Gemma-T4 (Thanks to Sleepdeprived) : https://huggingface.co/sleepdeprived3/Gemma3-T4</code></pre>
256
+ </div>
257
 
258
+ <div class="content-box">
259
+ <h2>⚙️ Configuration</h2>
260
+ <details>
261
+ <summary>SFT Trainer Config</summary>
262
+ <pre><code>
263
 
264
+ </code></pre>
265
+ </details>
266
+ </div>
267
 
268
+ <div class="content-box">
269
+ <h2>⚡ Credits</h2>
270
+ <div class="credits-grid">
271
+ <div class="credit-badge">
272
+ <a href="https://huggingface.co/lucyknada">Lucy Knada</a>
273
+ </div>
274
+ <div class="credit-badge">
275
+ <a href="https://huggingface.co/hamanasu">Ruka</a>
276
+ </div>
277
+ <div class="credit-badge">
278
+ <a href="https://huggingface.co/intervitens">Intervitens</a>
279
+ </div>
280
+ <div class="credit-badge">
281
+ <a href="https://huggingface.co/kalomaze">Kalomaze</a>
282
+ </div>
283
+ <div class="credit-badge">
284
+ <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a>
285
+ </div>
286
+ <div class="credit-badge">
287
+ <a href="https://huggingface.co/anthracite-org">Anthracite</a>
288
+ </div>
289
+ <div class="credit-badge">
290
+ <a href="https://huggingface.co/AliCat2">Alicat</a>
291
+ </div>
292
+ <div class="credit-badge">
293
+ <a href="https://huggingface.co/TearGosling">TearGosling</a>
294
+ </div>
295
+ </div>
296
+ </div>
297
 
298
+ <div style="text-align: center; margin-top: 40px;">
299
+ <div style="font-size:0.8em; opacity:0.8;">Made by</div>
300
+ <div style="font-size:1.4em; font-weight:bold; background: linear-gradient(45deg, #800000, #FFD700); -webkit-background-clip: text; -webkit-text-fill-color: transparent; display: inline-block;">Delta-Vector</div>
301
+ </div>
302
+ </div>
 
303
 
304
+ </body>
305
+ </html>