metadata

library_name: transformers
base_model:
  - meta-llama/Llama-2-7b-hf
tags:
  - llama-factory
  - full
  - diffusion
model-index:
  - name: diffullama
    results: []
license: apache-2.0
datasets:
  - bigcode/starcoderdata
  - cerebras/SlimPajama-627B

diffullama

This model is a fine-tuned version of [llama2].

Model description

Details and model loading can be seen https://github.com/HKUNLP/DiffuLLaMA.

Framework versions

Transformers 4.44.2
Pytorch 2.1.1+cu121
Datasets 2.21.0
Tokenizers 0.19.1