Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

Ctrl+K

Ctrl+K

100 contributors

History: 23 commits

winglian's picture

bugfixes

120e7df about 2 years ago

configs
fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets about 2 years ago
data
WIP for axolotl trainer about 2 years ago
scripts
bugfixes about 2 years ago
src
4bit quantized support (wip) about 2 years ago
.editorconfig

186 Bytes

WIP for axolotl trainer about 2 years ago
.gitattributes

49 Bytes

make it work with pythia in the cloud about 2 years ago
.gitignore
41 Bytes

WIP for axolotl trainer about 2 years ago
README.md
2.38 kB

fix install to work with latest alpaca lora 4bit about 2 years ago
ds_config.json
844 Bytes

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches about 2 years ago
requirements.txt
231 Bytes

fix install to work with latest alpaca lora 4bit about 2 years ago
setup.py
909 Bytes

fix install to work with latest alpaca lora 4bit about 2 years ago