File size: 1,002 Bytes
5cd4abc
 
6e7f1bd
c3c3add
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
---
## Gemma-codefeedback-7b

This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation [https://huggingface.co/Crystalcareai/GemMoE-Beta-1].

## Model Details

- **Dataset**: This model was fine-tuned on 3 epochs of the Crystalcareai/CodeFeedback-Alpaca dataset.
- **Architecture**: The fine-tuned model inherits the lean and efficient architecture of the base Gemma model, making it suitable for a wide range of applications with limited computational resources.

## Usage

You can use this fine-tuned model like any other HuggingFace model. Simply load it using the `from_pretrained` method:

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("huggingface-username/gemma-fine-tuned")
tokenizer = AutoTokenizer.from_pretrained("huggingface-username/gemma-fine-tuned")%%