llmixer
/

ExllamaV2-Control-Vectors

control vectors

creative writing

text generation

model integration

Model card Files Files and versions Community

ExllamaV2-Control-Vectors

1 contributor

History: 6 commits

llmixer's picture

Normalize hidden state after adding control vectors to preserve L2 norm

1f3dd72 about 2 months ago

gguf
Added test inference from exllamav2, added gguf-py from llama.cpp about 2 months ago
.gitattributes

1.52 kB

initial commit about 2 months ago
.gitignore

12 Bytes

Added control vectors parameter and wrapper about 2 months ago
README.md

2.19 kB

Update README.md about 2 months ago
exl2_wrapper.py

3.56 kB

Normalize hidden state after adding control vectors to preserve L2 norm about 2 months ago
test_inference.py

23.9 kB

Added control vectors parameter and wrapper about 2 months ago