Forgotten-Abomination-8B-V2.2-EXL2
This repository contains exl2 quants of Forgotten-Abomination-8B-V2.2, each in respective branch.
Built-in(default) calibration dataset is used.
Download:
To download, open directory you want to download to in your shell/CLI, then use huggingface-cli:
8bpw:
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 8bpw
6bpw:
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 6bpw
5bpw:
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 5bpw
4bpw:
huggingface-cli download riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2 --local-dir Forgotten-Abomination-8B-V2.2-EXL2 --local-dir-use-symlinks False --revision 4bpw
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.
Model tree for riveRiPH/Forgotten-Abomination-8B-V2.2-EXL2
Base model
ReadyArt/Forgotten-Abomination-8B-V2.2