Dovakiins/qwerrwe at 87e073d0deefd95913fb6ff782f65ac265e93f7b

qwerrwe / configs

Ctrl+K

100 contributors

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets

87e073d about 2 years ago

cerebras_1_3B_alpaca.yml
934 Bytes

4bit quantized support (wip) about 2 years ago
llama_65B_alpaca.yml
935 Bytes

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets about 2 years ago
llama_7B_4bit.yml
857 Bytes

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets about 2 years ago
llama_7B_alpaca.yml
933 Bytes

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets about 2 years ago
pythia_1_2B_alpaca.yml
978 Bytes

4bit quantized support (wip) about 2 years ago