---
library_name: transformers
base_model:
- meta-llama/Llama-2-7b-hf
tags:
- llama-factory
- full
- diffusion
model-index:
- name: diffullama
  results: []
license: apache-2.0
datasets:
- bigcode/starcoderdata
- cerebras/SlimPajama-627B
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# diffullama

This model is a fine-tuned version of [llama2].

## Model description

Details and model loading can be seen [https://github.com/HKUNLP/DiffuLLaMA](https://github.com/HKUNLP/DiffuLLaMA).


### Framework versions

- Transformers 4.44.2
- Pytorch 2.1.1+cu121
- Datasets 2.21.0
- Tokenizers 0.19.1