Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / src /axolotl /monkeypatch

Ctrl+K

Ctrl+K

100 contributors

History: 16 commits

ssmi153

Update XFormers Attention Monkeypatch to handle Llama-2 70B (GQA) (#339)

10405b9 unverified almost 2 years ago

llama_attn_hijack_flash.py

4.57 kB

move flash-attn monkey patch alongside the others almost 2 years ago
llama_attn_hijack_xformers.py
10.6 kB

Update XFormers Attention Monkeypatch to handle Llama-2 70B (GQA) (#339) almost 2 years ago
llama_landmark_attn.py

47.8 kB

Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var almost 2 years ago
xpos_rope_llama_monkey_patch.py

3.34 kB

add support to extend context with xpos rope almost 2 years ago