image/png

Experimental Athena v2 model. Use Alpaca format.

Description

Recommended settings - contributed by localfultonextractor

This repo contains fp16 files of Athena-V2.

GGUF - By TheBloke

GPTQ - By TheBloke

exl2 - by AzureBlack

AWQ - By TheBloke

OLD(GGUF - by IkariDev+Undi95)

Ratings:

Note: I have permission of all users to upload their ratings, i DONT screenshot random reviews without asking if i can put them here!

image/png

image/png

image/png

image/png

image/png

Models and loras used

  • Xwin-LM/Xwin-LM-13B-V0.1
  • Undi95/ReMM-v2.2-L2-13B
  • Undi95/MLewd-L2-13B-v2-3
  • Brouz/Slerpeno
  • boomerchan/Magpie-13b
[Xwin (0.30) + ReMM v2.2 (0.70)](0.45) x [[Xwin (0.40) + MLewd v2-3 (0.60)](0.80) + [Slerpeno(0.50) + Magpie-13b(0.50)](0.20)](0.55)

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

HUGE thanks to Undi95 for doing the merging (Recipe was my idea, he merged)

To TheBloke: please if you quant this, please include IkariDev + Undi95 in all the credits/links to the creator.

Downloads last month
1,179
Safetensors
Model size
13B params
Tensor type
F32
·
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for IkariDev/Athena-v2

Quantizations
3 models