Update README.md

README.md

@@ -2,199 +2,132 @@
 library_name: transformers
 tags:
 - llama-factory
+license: llama3
+datasets:
+- TheSkullery/Aether-Lite-V1.2
 ---
-
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
-
-
-
-## Model Details
-
-### Model Description
-
-<!-- Provide a longer summary of what this model is. -->
-
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
-
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-
-### Model Sources [optional]
-
-<!-- Provide the basic links for the model. -->
-
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-
-## Uses
-
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
+<!DOCTYPE html>
+<style>
+body {
+ font-family: 'Quicksand', sans-serif;
+ background: linear-gradient(135deg, #2E3440 0%, #1A202C 100%);
+ color: #D8DEE9;
+ margin: 0;
+ padding: 0;
+ font-size: 16px;
+}
+
+.container {
+ width: 80% auto;
+ max-width: 1080px auto;
+ margin: 20px auto;
+ background-color: rgba(255, 255, 255, 0.02);
+ padding: 20px;
+ border-radius: 12px;
+ box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2);
+ backdrop-filter: blur(10px);
+ border: 1px solid rgba(255, 255, 255, 0.1);
+}
+
+.header h1 {
+ font-size: 28px;
+ color: #ECEFF4;
+ margin: 0 0 20px 0;
+ text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3);
+}
+
+.update-section {
+ margin-top: 30px;
+}
+
+.update-section h2 {
+ font-size: 24px;
+ color: #88C0D0;
+}
+
+.update-section p {
+ font-size: 16px;
+ line-height: 1.6;
+ color: #ECEFF4;
+}
+
+.info img {
+ width: 100%;
+ border-radius: 10px;
+ margin-bottom: 15px;
+}
+
+a {
+ color: #88C0D0;
+ text-decoration: none;
+}
+
+a:hover {
+ color: #A3BE8C;
+}
+
+.button {
+ display: inline-block;
+ background-color: #5E81AC;
+ color: #E5E9F0;
+ padding: 10px 20px; 
+ border-radius: 5px;
+ cursor: pointer;
+ text-decoration: none;
+}
+
+.button:hover {
+ background-color: #81A1C1;
+}
+
+pre {
+ background-color: #2E3440;
+ padding: 10px;
+ border-radius: 5px;
+ overflow-x: auto;
+}
+
+code {
+ font-family: 'Courier New', monospace;
+ color: #D8DEE9;
+}
+
+</style>
+<html lang="en">
+<head>
+ <meta charset="UTF-8">
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
+ <title>L3-Aethora-15B Data Card</title>
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
+</head>
+<body>
+ <div class="container">
+ <div class="header">
+ <h1>L3-Aethora-15B</h1>
+ </div>
+ <div class="info">
+ <img src="https://cdn-uploads.huggingface.co/your-uploaded-image-link.png">
+ <p>The Skullery Presents L3-Aethora-15B.</p>
+ <p><strong>Creator:</strong> <a href="https://huggingface.co/steelskull" target="_blank">Steelskull</a></p>
+ <h1>About L3-Aethora-15B:</h1>
+ <p>L3-Aethora-15B was crafted through using the abilteration method to adjust model responses. The model's refusal is inhibited, focusing on yielding more compliant and facilitative dialogue interactions. It underwent a specialized merging process (originally used by @Elias) by using passthrough merge to create a 15b model, with specific adjustments to 'o_proj' and 'down_proj' settings, enhancing its efficiency and reducing perplexity. This created AbL3In-15b.<br>
+ <p>AbL3In-15b was then fine-tuned on the Aether-Lite-V1 dataset, containing ~82000 high quality samples, designed to strike a fine balance between creativity, slop, and intelligence at about a 60/40 split</p> 
+ <p>Filtered Phrases: GPTslop, Claudism's</p>
+ <h2>Dataset Summary: (Filtered)</h2>
+ <ul>
+ <li><strong>mrfakename/Pure-Dove-ShareGPT:</strong> Processed 3707, Removed 150</li>
+ <li><strong>mrfakename/Capybara-ShareGPT:</strong> Processed 13412, Removed 2594</li>
+ <li><strong>jondurbin/airoboros-3.2:</strong> Processed 54517, Removed 4192</li>
+ <li><strong>PJMixers/grimulkan_theory-of-mind-ShareGPT:</strong> Processed 533, Removed 6</li>
+ <li><strong>grimulkan/PIPPA-augmented-dedup:</strong> Processed 869, Removed 46</li>
+ <li><strong>grimulkan/LimaRP-augmented:</strong> Processed 790, Removed 14</li>
+ <li><strong>PJMixers/grimulkan_physical-reasoning-ShareGPT:</strong> Processed 895, Removed 4</li>
+ <li><strong>MinervaAI/Aesir-Preview:</strong> Processed 994, Removed 6</li>
+ <li><strong>Doctor-Shotgun/no-robots-sharegpt:</strong> Processed 9911, Removed 89</li>
+ </ul>
+ <h2>Deduplication Stats:</h2>
+ <p>Starting row count: 85628, Final row count: 81960, Rows removed: 3668</p>
+ </div>
+ </div>
+</body>
+</html>