File size: 1,662 Bytes
6ab48bc 209f2de 82d2de1 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de 6ab48bc 209f2de |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 |
---
datasets:
- ryandt/essay_thesis_conversations
language:
- en
library_name: transformers
license: mit
---
# Model Card for Model ID
This is a quick test at building a model that engages in a more "pedagogically grounded" rhetoric when helping students brainstorm.
It was developed in about a day as a proof of concept.
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** Ryan Tannenbaum and For.Education
- **Model type:** Llama 3.1 8B
- **Language(s) (NLP):** English
- **License:** MIT
- **Finetuned from model:** Llama 3.1 8B
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Demo [optional]:** Coming soon
## Uses
The model uses the following formatting:
```
### USER: <What the user says>
### ASSISTANT: <The bot response>
...
### TERMINATE
```
The model is programmed to "TERMINATE" the session when it reaches the end of its conversation
## Bias, Risks, and Limitations
This model uses an incredibly small dataset to tackle a very specific use case. It is a proof of concept.
### Training Data
[Essay Dataset](https://huggingface.co/datasets/ryandt/essay_thesis_conversations)
### Training Procedure
Trained with AutoTrain locally on 4090 card:
#### Training Hyperparameters
**Epochs**: 5
**Learning Rate**: 2e-5
**Train Batch Size**: 2
**Mixed Precision**: fp16
**Quantization**: int8
## Model Card Authors [optional]
Ryan Tannenbaum (ryandt)
## Model Card Contact
[Ryan Tannenbaum](mailto:[email protected]) |