Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /monkeypatch

Ctrl+K

Ctrl+K

100 contributors

History: 50 commits

xaviviro's picture

Added chatglm3 conversation type for training models like TinyLLama (#1036)

59b2d30 unverified over 1 year ago

mixtral
bump transformers and update attention class map name (#1023) over 1 year ago
btlm_attn_hijack_flash.py

2.32 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
fastchat_conversation_turns.py

8.33 kB

Added chatglm3 conversation type for training models like TinyLLama (#1036) over 1 year ago
llama_attn_hijack_flash.py

27.1 kB

adds llama and mistral dropout support (#858) over 1 year ago
llama_attn_hijack_sdp.py

4.81 kB

various bugfixes (#856) over 1 year ago
llama_attn_hijack_xformers.py

5.69 kB

various bugfixes (#856) over 1 year ago
llama_expand_mask.py

1.92 kB

Attention mask and position id fixes for packing (#285) almost 2 years ago
mistral_attn_hijack_flash.py

22.4 kB

adds llama and mistral dropout support (#858) over 1 year ago
relora.py

14 kB

fix checkpints on multigpu (#481) over 1 year ago
stablelm_attn_hijack_flash.py

15.4 kB

flash_attention + sample packing for stablelm 3b (#671) over 1 year ago
utils.py

4.2 kB

Implement fused modules (#747) over 1 year ago