diffullama / README.md
Sansa's picture
Update README.md
b20cd6d verified
|
raw
history blame
739 Bytes
metadata
library_name: transformers
base_model:
  - meta-llama/Llama-2-7b-hf
tags:
  - llama-factory
  - full
  - diffusion
model-index:
  - name: diffullama
    results: []
license: apache-2.0
datasets:
  - bigcode/starcoderdata
  - cerebras/SlimPajama-627B

diffullama

This model is a fine-tuned version of [llama2].

Model description

Details and model loading can be seen https://github.com/HKUNLP/DiffuLLaMA.

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.1.1+cu121
  • Datasets 2.21.0
  • Tokenizers 0.19.1